00000001:02000400:0.0F:1783946518.203576:0:3102:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1783946533.234503:0:3323:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1783946535.152425:0:3386:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 739 MB/s 00000001:01000000:3.0:1783946535.402151:0:3386:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1359 MB/s 00000001:01000000:2.0:1783946535.652128:0:3386:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9311 MB/s 00000020:02000000:0.0:1783946536.089791:0:3416:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_ga4ac164 00000400:02000000:0.0:1783946536.839672:0:3431:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.201.118@tcp [8/256/0/180] 00008000:02000000:3.0:1783946539.812723:0:3580:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1783946598.705009:0:5183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783946615.736032:0:5933:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783946615.736040:0:5933:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783946615.736041:0:5933:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783946615.743605:0:5933:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d5ef8bea 00000080:02000400:2.0:1783946615.743621:0:5933:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1783946615.759616:0:5933:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1783946615.759631:0:5933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783946615.759665:0:5933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000738baba0) 00000020:00000080:2.0:1783946615.759695:0:5933:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783946615.870345:0:5933:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783946615.870432:0:5933:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1783946615.926632:0:5933:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783946615.926869:0:5933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783946615.926877:0:5933:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783946615.926890:0:5933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db6f4b 00000020:01000004:3.0:1783946615.926897:0:5933:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783946615.926902:0:5933:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783946615.926907:0:5933:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d5ef8bea from MGS 00000020:01000004:3.0:1783946615.926912:0:5933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783946615.926937:0:5933:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d70a3ae3) 00000020:00000080:3.0:1783946615.926950:0:5933:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783946615.927112:0:5933:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d5ef8bea from MGS, refs=2 00080000:01000000:3.0:1783946615.927118:0:5933:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783946615.927123:0:5933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db6f59 00000100:00100000:2.0:1783946615.927369:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783946615.927510:0:5933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783946615.927517:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783946615.930441:0:5933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783946615.930455:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783946615.934774:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946615.934972:0:5933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783946615.934979:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783946615.936357:0:5933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783946615.936368:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783946615.937942:0:5933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783946615.937952:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783946615.948722:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946615.948728:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946615.948730:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946615.949676:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946615.949679:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946615.949681:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946615.953006:0:5933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783946615.964976:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1783946616.205866:0:5933:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1335 MB/s 00000001:01000000:1.0:1783946616.456581:0:5933:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1988 MB/s 00000001:01000000:2.0:1783946616.707761:0:5933:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 386 MB/s 00000001:01000000:3.0:1783946616.961583:0:5933:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 416 MB/s 00010000:00010000:3.0:1783946616.976256:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1783946617.001941:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1783946617.045398:0:5933:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783946617.056477:0:5947:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783946617.058839:0:5933:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783946617.058921:0:5933:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1783946617.059592:0:5933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783946617.059622:0:5933:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783946617.060641:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783946617.062599:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783946617.062607:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783946617.066019:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783946617.066040:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783946617.069688:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783946617.069704:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1783946617.071207:0:5952:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1783946617.071254:0:5933:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783946617.071278:0:5933:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.118@tcp' 00000020:01000004:0.0:1783946617.071280:0:5933:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783946617.071326:0:5933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.118@tcp (typ=mgc) 00000020:00000080:0.0:1783946617.071347:0:5933:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.118@tcp (00000000dcba0ab3) 00000020:00000080:0.0:1783946617.071365:0:5933:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783946617.071503:0:5933:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006cecf0d5@MGC192.168.201.118@tcp: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1783946617.071668:0:5933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.118@tcp-0 is initialized 00000040:01000000:0.0:1783946617.071676:0:5933:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 1 is initialized 10000000:01000000:1.0:1783946617.076487:0:5953:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1783946617.078784:0:5933:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.118@tcp (uuid b032bb55-8d94-4093-96f3-a2f6fadccf82) 00000020:00000080:0.0:1783946617.078818:0:5933:0:(genops.c:1406:class_connect()) connect: client b032bb55-8d94-4093-96f3-a2f6fadccf82, cookie 0x229d2ec450db6f67 00000100:00080000:0.0:1783946617.078831:0:5933:0:(import.c:510:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783946617.078837:0:5933:0:(import.c:624:import_select_connection()) MGC192.168.201.118@tcp: import 000000006cecf0d5 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946617.078891:0:5933:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000351c8a55 x1870603522932864/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783946617.078927:0:5933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b032bb55-8d94-4093-96f3-a2f6fadccf82->MGS 00000020:01000004:0.0:1783946617.078952:0:5933:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783946617.078957:0:5933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1783946617.078970:0:5933:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003b5391c1) 00000020:00000080:0.0:1783946617.078982:0:5933:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1783946617.079665:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000351c8a55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b032bb55-8d94-4093-96f3-a2f6fadccf82:3446:1870603522932864:0@lo:250: 00000100:00100000:1.0:1783946617.079779:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946617.080341:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522932864 00000100:00100000:2.0:1783946617.080353:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522932864 00000100:00100000:1.0:1783946617.087649:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783946617.087663:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2a10b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3446:x1870603522932864:12345-0@lo:250: 00010000:00080000:1.0:1783946617.087701:0:5950:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from b032bb55-8d94-4093-96f3-a2f6fadccf82@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1783946617.087734:0:5950:0:(genops.c:1406:class_connect()) connect: client b032bb55-8d94-4093-96f3-a2f6fadccf82, cookie 0x229d2ec450db6f75 00000100:00080000:1.0:1783946617.087901:0:5950:0:(import.c:65:import_set_state_nolock()) 00000000283bb471 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783946617.088007:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2a10b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:3446:x1870603522932864:12345-0@lo:250: Request processed in 344us (8227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946617.088015:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783946617.088319:0:3446:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783946617.088331:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.118@tcp: connect to target with instance 0 00000100:00080000:1.0:1783946617.088339:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783946617.088345:0:3446:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783946617.088348:0:3446:0:(import.c:65:import_set_state_nolock()) 000000006cecf0d5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783946617.088350:0:3446:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783946617.088359:0:3446:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783946617.088364:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000351c8a55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b032bb55-8d94-4093-96f3-a2f6fadccf82:3446:1870603522932864:0@lo:250: 00000100:00100000:0.0:1783946617.103812:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946617.104031:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1783946617.104038:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783946617.122316:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783946617.122329:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783946617.122803:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783946617.122810:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783946617.126775:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783946617.126973:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783946617.126981:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783946617.133661:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783946617.133686:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783946617.208581:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783946617.208804:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783946617.208811:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783946617.210762:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783946617.210775:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783946617.211802:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946617.211961:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783946617.211966:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1783946617.219413:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783946617.219444:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783946617.231923:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783946617.233415:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783946617.233439:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783946617.234782:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783946617.234793:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783946617.245789:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783946617.246000:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783946617.246007:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783946617.248190:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783946617.248399:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783946617.284441:0:5933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783946617.284673:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783946617.284680:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783946617.293934:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783946617.293951:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783946617.309485:0:5933:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783946617.309622:0:5933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783946617.311803:0:5933:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783946617.311838:0:5933:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783946617.311844:0:5933:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783946617.311964:0:5933:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783946617.312002:0:5933:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1783946617.312007:0:5933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783946617.312009:0:5933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783946617.312011:0:5933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783946617.312012:0:5933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783946617.312014:0:5933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783946617.312015:0:5933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783946617.312016:0:5933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783946617.312018:0:5933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783946617.312019:0:5933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783946617.312020:0:5933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783946617.312022:0:5933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783946617.312023:0:5933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783946617.312025:0:5933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1783946617.312028:0:5933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783946617.312029:0:5933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783946617.312031:0:5933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783946617.312032:0:5933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783946617.312033:0:5933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783946617.312034:0:5933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783946617.312035:0:5933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783946617.312036:0:5933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783946617.312037:0:5933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783946617.312037:0:5933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783946617.312042:0:5933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783946617.312043:0:5933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783946617.312123:0:5933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783946617.312151:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cd527421 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522932992:0@lo:253: 00000100:00100000:1.0:1783946617.313408:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946617.313541:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f66435ef going to sleep for 11 seconds 00000100:00100000:3.0:1783946617.316297:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522932992 00000100:00100000:3.0:1783946617.316314:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522932992 00000100:00100000:3.0:1783946617.316367:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783946617.316376:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f232d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:5933:x1870603522932992:12345-0@lo:253: 20000000:01000000:3.0:1783946617.316449:0:5951:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783946617.316452:0:5951:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1783946617.322888:0:5972:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783946617.323027:0:5951:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1783946617.323969:0:5951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783946617.328408:0:5973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1783946617.328877:0:5951:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783946617.328882:0:5951:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1783946617.328887:0:5951:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1783946617.328890:0:5951:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1783946617.328913:0:5951:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1783946617.329156:0:5951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783946617.329477:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1783946617.329492:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783946617.329511:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1783946617.329528:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1783946617.329541:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1783946617.329595:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1783946617.329603:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1783946617.329617:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1783946617.329624:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1783946617.329636:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1783946617.329973:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1783946617.329994:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1783946617.330011:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1783946617.330038:0:5951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1783946617.330044:0:5951:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1783946617.330052:0:5951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783946617.330347:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1783946617.330360:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783946617.330373:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1783946617.330386:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1783946617.330399:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1783946617.330406:0:5951:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1783946617.330429:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1783946617.330435:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783946617.330457:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1783946617.330469:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1783946617.330482:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1783946617.330490:0:5951:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1783946617.330510:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1783946617.330516:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1783946617.330536:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1783946617.330552:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1783946617.330606:0:5951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1783946617.330627:0:5951:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1783946617.330633:0:5951:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783946617.340033:0:5974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783946617.340427:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783946617.340459:0:5951:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.118@tcp for mdt 20000000:01000000:1.0:1783946617.340461:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:1.0:1783946617.340478:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783946617.340484:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783946617.340495:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783946617.340500:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:1.0:1783946617.340510:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783946617.340517:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783946617.340529:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783946617.340542:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783946617.340572:0:5951:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783946617.340576:0:5951:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783946617.340579:0:5951:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783946617.340630:0:5951:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783946617.340633:0:5951:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783946617.342731:0:5975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1783946617.343103:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1783946617.343135:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1783946617.343150:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1783946617.343171:0:5951:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783946617.343173:0:5951:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783946617.343597:0:5976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1783946617.343820:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1783946617.343841:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1783946617.343856:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1783946617.343866:0:5951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783946617.343874:0:5951:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1783946617.343879:0:5951:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783946617.343882:0:5951:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783946617.343887:0:5951:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1783946617.343893:0:5951:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1783946617.345572:0:5977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1783946617.345798:0:5951:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783946617.353153:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1783946617.353200:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1783946617.353218:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1783946617.353241:0:5951:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783946617.353268:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353290:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353302:0:5951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353308:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353316:0:5951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353321:0:5951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353325:0:5951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe09277d already unused, calling callback (0000000001d9f768) 00010000:00010000:1.0:1783946617.353328:0:5951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353346:0:5951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353357:0:5951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353363:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.353366:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f7c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783946617.353382:0:5951:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783946617.368421:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f232d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:5933:x1870603522932992:12345-0@lo:253: Request processed in 52036us (55008us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946617.368444:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946617.369779:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cd527421 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522932992:0@lo:253: 10000000:01000000:2.0:1783946617.369801:0:5933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783946617.369804:0:5933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783946617.369806:0:5933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783946617.369808:0:5933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946617.369809:0:5933:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783946617.369810:0:5933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946617.369811:0:5933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946617.369812:0:5933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783946617.369814:0:5933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783946617.369816:0:5933:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783946617.369818:0:5933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946617.369819:0:5933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783946617.369848:0:5933:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d5ef8bea from lustre-MDT0000 10000000:01000000:2.0:1783946617.369881:0:5933:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783946617.369884:0:5933:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783946617.369888:0:5933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9137909d0000 10000000:01000000:2.0:1783946617.369892:0:5933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783946617.369901:0:5933:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9137909d0000 from 1 10000000:01000000:2.0:1783946617.369903:0:5933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783946617.369972:0:5933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e2c86cdb/0x229d2ec450db6f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.369984:0:5933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000e2c86cdb/0x229d2ec450db6f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.369993:0:5933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000e2c86cdb/0x229d2ec450db6f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946617.370024:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e4c2aa0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933120:0@lo:101: 00000100:00100000:2.0:1783946617.370120:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946617.370297:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e82265c9 going to sleep for 11 seconds 00000100:00100000:3.0:1783946617.371126:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522933120 00000100:00100000:3.0:1783946617.371137:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522933120 00000100:00100000:3.0:1783946617.371213:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783946617.371224:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017aa0360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:5933:x1870603522933120:12345-0@lo:101: 00010000:00010000:3.0:1783946617.371243:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946617.371261:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091fd51cc/0x229d2ec450db6f8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db6f83 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.371291:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091fd51cc/0x229d2ec450db6f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db6f83 expref: 6 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.371302:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091fd51cc/0x229d2ec450db6f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db6f83 expref: 6 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.371311:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091fd51cc, rc 0) 00000100:00100000:3.0:1783946617.371370:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017aa0360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+6:5933:x1870603522933120:12345-0@lo:101: Request processed in 148us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946617.371391:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783946617.371592:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e4c2aa0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933120:0@lo:101: 00010000:00010000:2.0:1783946617.371611:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000e2c86cdb/0x229d2ec450db6f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.371621:0:5933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000e2c86cdb/0x229d2ec450db6f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946617.371701:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e4c2aa0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933248:0@lo:501: 00000100:00100000:2.0:1783946617.371736:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946617.371797:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522933248 00000100:00100000:1.0:1783946617.371801:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522933248 00000100:00100000:1.0:1783946617.371842:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783946617.371847:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b60a63a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+6:5933:x1870603522933248:12345-0@lo:501: 00000100:00100000:1.0:1783946617.371916:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b60a63a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+6:5933:x1870603522933248:12345-0@lo:501: Request processed in 69us (180us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783946617.371922:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946617.372367:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e82265c9 going to sleep for 11 seconds 00000100:00100000:2.0:1783946617.372381:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e4c2aa0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933248:0@lo:501: 10000000:01000000:2.0:1783946617.372409:0:5933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783946617.372456:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e2c86cdb/0x229d2ec450db6f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.372465:0:5933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000e2c86cdb/0x229d2ec450db6f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946617.372474:0:5933:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff913786178000 10000000:01000000:2.0:1783946617.372481:0:5933:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783946617.372486:0:5933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff913786178000 10000000:01000000:2.0:1783946617.372489:0:5933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783946617.372491:0:5933:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff913786178000 from 1 10000000:01000000:2.0:1783946617.372500:0:5933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783946617.372521:0:5933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000c0bc6d46/0x229d2ec450db6f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.372528:0:5933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000c0bc6d46/0x229d2ec450db6f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.372536:0:5933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000c0bc6d46/0x229d2ec450db6f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946617.372711:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e4c2aa0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933376:0@lo:101: 00000100:00100000:2.0:1783946617.372742:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946617.372763:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e82265c9 going to sleep for 11 seconds 00000100:00100000:1.0:1783946617.372813:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522933376 00000100:00100000:1.0:1783946617.372818:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522933376 00000100:00100000:1.0:1783946617.372853:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783946617.372860:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f29fe7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+6:5933:x1870603522933376:12345-0@lo:101: 00010000:00010000:1.0:1783946617.372869:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946617.372880:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db6f91 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.372896:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db6f91 expref: 7 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.372913:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe09277d/0x229d2ec450db6f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db6f91 expref: 7 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.372920:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe09277d, rc 0) 00000100:00100000:1.0:1783946617.372963:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f29fe7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+7:5933:x1870603522933376:12345-0@lo:101: Request processed in 104us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946617.372969:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783946617.373050:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e4c2aa0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933376:0@lo:101: 00010000:00010000:0.0:1783946617.373084:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000c0bc6d46/0x229d2ec450db6f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.373158:0:5933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000c0bc6d46/0x229d2ec450db6f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946617.373181:0:5933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783946617.373456:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000c0bc6d46/0x229d2ec450db6f91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.373465:0:5933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000c0bc6d46/0x229d2ec450db6f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946617.373480:0:5933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783946617.373484:0:5933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783946617.373489:0:5933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff913786178000 10000000:01000000:0.0:1783946617.373492:0:5933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783946617.373496:0:5933:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783946617.373498:0:5933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783946617.373522:0:5933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000d4aa00fb/0x229d2ec450db6f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.373529:0:5933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000d4aa00fb/0x229d2ec450db6f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.373536:0:5933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000d4aa00fb/0x229d2ec450db6f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946617.373566:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933504:0@lo:101: 00000100:00100000:0.0:1783946617.373600:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946617.373630:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac6243cf going to sleep for 11 seconds 00000100:00100000:2.0:1783946617.373730:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522933504 00000100:00100000:2.0:1783946617.373736:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522933504 00000100:00100000:2.0:1783946617.373775:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783946617.373784:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be4bbb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+7:5933:x1870603522933504:12345-0@lo:101: 00010000:00010000:2.0:1783946617.373792:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946617.373803:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069867167/0x229d2ec450db6fa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db6f9f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.373819:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069867167/0x229d2ec450db6fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db6f9f expref: 8 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.373827:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069867167/0x229d2ec450db6fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db6f9f expref: 8 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.373834:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069867167, rc 0) 00000100:00100000:2.0:1783946617.373866:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be4bbb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+8:5933:x1870603522933504:12345-0@lo:101: Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946617.373881:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783946617.374439:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933504:0@lo:101: 00010000:00010000:0.0:1783946617.374455:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000d4aa00fb/0x229d2ec450db6f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.374464:0:5933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000d4aa00fb/0x229d2ec450db6f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946617.374543:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933632:0@lo:501: 00000100:00100000:0.0:1783946617.374771:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946617.374814:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac6243cf going to sleep for 11 seconds 00000100:00100000:1.0:1783946617.374873:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522933632 00000100:00100000:1.0:1783946617.374879:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522933632 00000100:00100000:1.0:1783946617.374919:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783946617.374926:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dc5ab8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+8:5933:x1870603522933632:12345-0@lo:501: 00000100:00100000:1.0:1783946617.375041:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dc5ab8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:5933:x1870603522933632:12345-0@lo:501: Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946617.375048:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783946617.375329:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933632:0@lo:501: 00000100:00100000:0.0:1783946617.375362:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933760:0@lo:503: 00000100:00100000:0.0:1783946617.375399:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946617.375415:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac6243cf going to sleep for 11 seconds 00000100:00100000:0.0:1783946617.375428:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522933760 00000100:00100000:0.0:1783946617.375432:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522933760 00000100:00100000:0.0:1783946617.375462:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783946617.375469:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063148eba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:5933:x1870603522933760:12345-0@lo:503: 00000100:00100000:0.0:1783946617.375713:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063148eba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:5933:x1870603522933760:12345-0@lo:503: Request processed in 243us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946617.375720:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783946617.375757:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522933760:0@lo:503: 00000100:00100000:0.0:1783946617.376432:0:5978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:5978:1870603522933888:0@lo:502: 00000100:00100000:0.0:1783946617.376477:0:5978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946617.376508:0:5978:0:(client.c:2702:ptlrpc_set_wait()) set 000000007c7f04b7 going to sleep for 11 seconds 00000100:00100000:2.0:1783946617.376570:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522933888 00000100:00100000:2.0:1783946617.376575:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522933888 00000100:00100000:2.0:1783946617.376611:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783946617.376618:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b99330b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:5978:x1870603522933888:12345-0@lo:502: 00000100:00100000:2.0:1783946617.376892:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b99330b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:5978:x1870603522933888:12345-0@lo:502: Request processed in 273us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946617.376900:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783946617.376990:0:5978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:5978:1870603522933888:0@lo:502: 00000020:01000000:0.0:1783946617.377015:0:5978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946617.377026:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946617.377028:0:5978:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783946617.377034:0:5978:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783946617.377036:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783946617.377050:0:5978:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000066a1a06d) 00000020:00000080:0.0:1783946617.377278:0:5978:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783946617.377287:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783946617.377372:0:5978:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783946617.377378:0:5978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db6fb4 00000020:00000080:0.0:1783946617.377878:0:5978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783946617.377889:0:5978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946617.377893:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946617.377894:0:5978:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783946617.377897:0:5978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946617.377901:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946617.377902:0:5978:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783946617.377906:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783946617.377914:0:5978:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000010e8a4a5) 00000020:00000080:0.0:1783946617.377926:0:5978:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783946617.377930:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783946617.377931:0:5978:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783946617.377934:0:5978:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783946617.377940:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783946617.377984:0:5978:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d5ef8bea from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783946617.378005:0:5978:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002514ed89) 00000020:00000080:0.0:1783946617.378014:0:5978:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783946617.378286:0:5978:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783946617.378293:0:5978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db6fc9 00000020:00000080:0.0:1783946617.378406:0:5978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783946617.378413:0:5978:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783946617.378417:0:5978:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x229d2ec450db6fd0 00080000:01000000:0.0:1783946617.378423:0:5978:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783946617.378427:0:5978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db6fd7 00080000:10000000:0.0:1783946617.379430:0:5978:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1783946617.379593:0:5978:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1783946617.384557:0:5978:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783946617.473418:0:5978:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783946617.476183:0:5978:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783946617.482251:0:5978:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783946617.482895:0:5978:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783946617.489351:0:5978:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000bc37cc0a) 00000020:00000080:2.0:1783946617.489377:0:5978:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783946617.489488:0:5978:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783946617.489496:0:5978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db6fe5 00000020:00000080:2.0:1783946617.493569:0:5978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1783946617.497808:0:5978:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1783946617.501362:0:5978:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1783946617.511520:0:5978:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1783946617.515754:0:5978:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1783946617.522928:0:5978:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1783946617.524903:0:5978:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1783946617.526930:0:5978:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x229d2ec450db6fec 00000020:00000080:0.0:1783946617.527311:0:5978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783946617.527328:0:5978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946617.527335:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946617.527337:0:5978:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783946617.527340:0:5978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946617.527344:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946617.527345:0:5978:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783946617.527348:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783946617.527350:0:5978:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783946617.527352:0:5978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946617.527354:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946617.527356:0:5978:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783946617.527358:0:5978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946617.527363:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946617.527364:0:5978:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783946617.527368:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783946617.527408:0:5978:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1783946617.527491:0:5978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:5978:1870603522934016:0@lo:502: 00000100:00100000:0.0:1783946617.527576:0:5978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946617.527632:0:5978:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c3f2aaca going to sleep for 11 seconds 00000100:00100000:1.0:1783946617.527787:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522934016 00000100:00100000:1.0:1783946617.527797:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522934016 00000100:00100000:1.0:1783946617.527853:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783946617.527862:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bf7ae20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:5978:x1870603522934016:12345-0@lo:502: 00000100:00100000:1.0:1783946617.527979:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bf7ae20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:5978:x1870603522934016:12345-0@lo:502: Request processed in 118us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946617.527987:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783946617.528138:0:5978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:5978:1870603522934016:0@lo:502: 00000020:01000000:0.0:1783946617.528176:0:5978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946617.528181:0:5978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946617.528183:0:5978:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1783946617.528279:0:5978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783946617.531508:0:5933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783946617.531563:0:5933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783946617.531588:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000d4aa00fb/0x229d2ec450db6f9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.531602:0:5933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000d4aa00fb/0x229d2ec450db6f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946617.531631:0:5933:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff913786178000 from 1 10000000:01000000:1.0:1783946617.531634:0:5933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783946617.532353:0:5933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.532367:0:5933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946617.532379:0:5933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946617.532410:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ab12ea87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934144:0@lo:101: 00000100:00100000:1.0:1783946617.532660:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946617.532741:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 000000005b1a33c8 going to sleep for 11 seconds 00000100:00100000:0.0:1783946617.534775:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522934144 00000100:00100000:0.0:1783946617.534792:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522934144 00000100:00100000:0.0:1783946617.534854:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783946617.534863:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050b57028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:5933:x1870603522934144:12345-0@lo:101: 00010000:00010000:0.0:1783946617.534888:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946617.534914:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db6ff3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.534963:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db6ff3 expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.534973:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db6ff3 expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.534984:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067b640e2, rc 0) 00000100:00100000:0.0:1783946617.535110:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050b57028 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+10:5933:x1870603522934144:12345-0@lo:101: Request processed in 248us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946617.535117:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783946617.535387:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ab12ea87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934144:0@lo:101: 00010000:00010000:2.0:1783946617.535408:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.535419:0:5933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946617.536025:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee7705c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934272:0@lo:256: 00000100:00100000:3.0:1783946617.536591:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946617.536756:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522934272 00000100:00100000:2.0:1783946617.536764:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522934272 00000100:00100000:2.0:1783946617.536838:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783946617.536847:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a957dea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+10:5933:x1870603522934272:12345-0@lo:256: 20000000:01000000:2.0:1783946617.536870:0:5951:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783946617.536876:0:5951:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783946617.536950:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a957dea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+10:5933:x1870603522934272:12345-0@lo:256: Request processed in 105us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946617.536959:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783946617.537028:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000577860bd going to sleep for 11 seconds 00000100:00100000:3.0:1783946617.537049:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee7705c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934272:0@lo:256: 10000000:01000000:3.0:1783946617.537613:0:5933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783946617.537631:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.537653:0:5933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946617.537662:0:5933:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff913786178000 from 1 10000000:01000000:3.0:1783946617.537665:0:5933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783946617.537715:0:5933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.537722:0:5933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.537732:0:5933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946617.537749:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c0c3aa1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934400:0@lo:101: 00000100:00100000:3.0:1783946617.537792:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946617.537811:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dcf5e552 going to sleep for 11 seconds 00000100:00100000:0.0:1783946617.538715:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522934400 00000100:00100000:0.0:1783946617.538724:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522934400 00000100:00100000:0.0:1783946617.538773:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783946617.538782:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f9a387a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+10:5933:x1870603522934400:12345-0@lo:101: 00010000:00010000:0.0:1783946617.538796:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946617.538812:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7001 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.538837:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7001 expref: 11 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.538848:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7001 expref: 11 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.538858:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000027b3fcfd, rc 0) 00000100:00100000:0.0:1783946617.538911:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f9a387a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:5933:x1870603522934400:12345-0@lo:101: Request processed in 130us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946617.538918:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783946617.539214:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c0c3aa1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934400:0@lo:101: 00010000:00010000:3.0:1783946617.539237:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.539246:0:5933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946617.539314:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c0c3aa1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934528:0@lo:501: 00000100:00100000:3.0:1783946617.539344:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946617.539885:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522934528 00000100:00100000:0.0:1783946617.539891:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522934528 00000100:00100000:0.0:1783946617.539929:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783946617.539936:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be52a17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:5933:x1870603522934528:12345-0@lo:501: 00000100:00100000:0.0:1783946617.540132:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be52a17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:5933:x1870603522934528:12345-0@lo:501: Request processed in 197us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946617.540140:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783946617.540498:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dcf5e552 going to sleep for 11 seconds 00000100:00100000:3.0:1783946617.540517:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c0c3aa1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934528:0@lo:501: 00000100:00100000:3.0:1783946617.540553:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c0c3aa1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934656:0@lo:503: 00000100:00100000:3.0:1783946617.540596:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946617.540616:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dcf5e552 going to sleep for 11 seconds 00000100:00100000:2.0:1783946617.540760:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522934656 00000100:00100000:2.0:1783946617.540766:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522934656 00000100:00100000:2.0:1783946617.540806:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783946617.540812:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1993cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:5933:x1870603522934656:12345-0@lo:503: 00000040:00080000:2.0:1783946617.540849:0:5951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783946617.540890:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1993cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:5933:x1870603522934656:12345-0@lo:503: Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946617.540896:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783946617.540935:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c0c3aa1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934656:0@lo:503: 00000040:00080000:3.0:1783946617.542794:0:5982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783946617.543047:0:5933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783946617.543106:0:5933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783946617.543127:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.543140:0:5933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946617.543312:0:5933:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783946617.543315:0:5933:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff913786178000 10000000:01000000:2.0:1783946617.543319:0:5933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff913786178000 10000000:01000000:2.0:1783946617.543323:0:5933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783946617.543338:0:5933:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff913786178000 from 1 10000000:01000000:2.0:1783946617.543340:0:5933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783946617.543385:0:5933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 0000000012d8bf99/0x229d2ec450db700f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.543395:0:5933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 0000000012d8bf99/0x229d2ec450db700f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.543406:0:5933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 0000000012d8bf99/0x229d2ec450db700f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946617.543431:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000bd55a7e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934784:0@lo:101: 00000100:00100000:2.0:1783946617.543503:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946617.543541:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000577860bd going to sleep for 11 seconds 00000100:00100000:3.0:1783946617.543970:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522934784 00000100:00100000:3.0:1783946617.543979:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522934784 00000100:00100000:3.0:1783946617.544034:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783946617.544043:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7424aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:5933:x1870603522934784:12345-0@lo:101: 00010000:00010000:3.0:1783946617.544263:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946617.544286:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000965625e2/0x229d2ec450db7016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db700f expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.544551:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000965625e2/0x229d2ec450db7016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db700f expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.544565:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000965625e2/0x229d2ec450db7016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db700f expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.544589:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000965625e2, rc 0) 00000100:00100000:3.0:1783946617.544752:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7424aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5933:x1870603522934784:12345-0@lo:101: Request processed in 709us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946617.544760:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783946617.545005:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000bd55a7e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934784:0@lo:101: 00010000:00010000:2.0:1783946617.545025:0:5933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 0000000012d8bf99/0x229d2ec450db700f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.545036:0:5933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 0000000012d8bf99/0x229d2ec450db700f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946617.545481:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000191181d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934912:0@lo:501: 00000100:00100000:3.0:1783946617.545520:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946617.545581:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fb63dc7d going to sleep for 11 seconds 00000100:00100000:0.0:1783946617.545615:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522934912 00000100:00100000:0.0:1783946617.545622:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522934912 00000100:00100000:0.0:1783946617.545768:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783946617.545779:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b43ac468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5933:x1870603522934912:12345-0@lo:501: 00000100:00100000:0.0:1783946617.545936:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b43ac468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5933:x1870603522934912:12345-0@lo:501: Request processed in 160us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946617.545944:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783946617.546006:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000191181d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522934912:0@lo:501: 00000100:00100000:3.0:1783946617.546035:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000191181d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522935040:0@lo:503: 00000100:00100000:3.0:1783946617.546101:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946617.554399:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522935040 00000100:00100000:2.0:1783946617.554421:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522935040 00000100:00100000:2.0:1783946617.554488:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783946617.554497:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000152e34ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5933:x1870603522935040:12345-0@lo:503: 00000100:00100000:2.0:1783946617.554675:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000152e34ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5933:x1870603522935040:12345-0@lo:503: Request processed in 178us (8573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946617.554683:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783946617.554952:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fb63dc7d going to sleep for 11 seconds 00000100:00100000:3.0:1783946617.554984:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000191181d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522935040:0@lo:503: 00000100:00100000:0.0:1783946617.555574:0:5983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:5983:1870603522935168:0@lo:502: 00000100:00100000:0.0:1783946617.555631:0:5983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946617.555668:0:5983:0:(client.c:2702:ptlrpc_set_wait()) set 000000004a613d09 going to sleep for 11 seconds 00000100:00100000:2.0:1783946617.555764:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522935168 00000100:00100000:2.0:1783946617.555775:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522935168 00000100:00100000:2.0:1783946617.555812:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783946617.555820:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c164c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5983:x1870603522935168:12345-0@lo:502: 00000100:00100000:2.0:1783946617.555929:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c164c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5983:x1870603522935168:12345-0@lo:502: Request processed in 109us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946617.555936:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783946617.556027:0:5983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e138b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:5983:1870603522935168:0@lo:502: 00000020:01000004:1.0:1783946617.556124:0:5983:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783946617.556145:0:5983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009454440b) 00000020:00000080:1.0:1783946617.556174:0:5983:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1783946617.556354:0:5983:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d5ef8bea from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783946617.556360:0:5983:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d5ef8bea from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783946617.556363:0:5983:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d5ef8bea 4 00010000:00080000:1.0:1783946617.556395:0:5983:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000765c965@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1783946617.558596:0:5983:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1783946617.558710:0:5983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783946617.558755:0:5983:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783946617.558789:0:5983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x229d2ec450db7024 00000100:00080000:1.0:1783946617.558805:0:5983:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783946617.558812:0:5983:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000765c965 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946617.558864:0:5983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ea81d4f x1870603522935296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783946617.558919:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ea81d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603522935296:0@lo:38: 00000100:00100000:1.0:1783946617.558992:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783946617.559039:0:5983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783946617.563802:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522935296 00000100:00100000:0.0:1783946617.563821:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522935296 00000100:00100000:0.0:1783946617.563876:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946617.563886:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fed397e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3446:x1870603522935296:12345-0@lo:38: 00000100:00100000:0.0:1783946617.563991:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fed397e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3446:x1870603522935296:12345-0@lo:38: Request processed in 105us (4999us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783946617.563999:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946617.564082:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783946617.564093:0:3446:0:(import.c:65:import_set_state_nolock()) 000000000765c965 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783946617.564098:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783946617.564102:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ea81d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603522935296:0@lo:38: 00000100:00100000:1.0:1783946617.566313:0:5983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071f19229 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:5983:1870603522935424:0@lo:502: 00000100:00100000:1.0:1783946617.566397:0:5983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946617.566462:0:5983:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b8baae6f going to sleep for 11 seconds 00000100:00100000:3.0:1783946617.567232:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522935424 00000100:00100000:3.0:1783946617.567242:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522935424 00000100:00100000:3.0:1783946617.567298:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783946617.567308:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b5727c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5983:x1870603522935424:12345-0@lo:502: 00000100:00100000:3.0:1783946617.567472:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b5727c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5983:x1870603522935424:12345-0@lo:502: Request processed in 166us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946617.567481:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783946617.567856:0:5983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071f19229 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:5983:1870603522935424:0@lo:502: 00000040:00080000:0.0:1783946617.567894:0:5983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1783946617.568739:0:5933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1783946617.568766:0:5933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783946617.568785:0:5933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 0000000012d8bf99/0x229d2ec450db700f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946617.568798:0:5933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 0000000012d8bf99/0x229d2ec450db700f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783946617.568867:0:5933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783946617.568869:0:5933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783946617.568870:0:5933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946617.568871:0:5933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783946617.568873:0:5933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946617.568874:0:5933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946617.568875:0:5933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783946617.568877:0:5933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783946617.568878:0:5933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783946617.568879:0:5933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783946617.568881:0:5933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946617.568882:0:5933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783946617.568885:0:5933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1783946617.568888:0:5933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783946617.568889:0:5933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783946617.568890:0:5933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946617.568891:0:5933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783946617.568892:0:5933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946617.568893:0:5933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946617.568893:0:5933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783946617.568894:0:5933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783946617.568895:0:5933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783946617.568896:0:5933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783946617.568897:0:5933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946617.568897:0:5933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783946617.568923:0:5933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783946617.568940:0:5933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000191181d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522935552:0@lo:253: 00000100:00100000:3.0:1783946617.568992:0:5933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946617.569022:0:5933:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026e579aa going to sleep for 11 seconds 00000100:00100000:1.0:1783946617.569291:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522935552 00000100:00100000:1.0:1783946617.569299:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522935552 00000100:00100000:1.0:1783946617.569346:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783946617.569356:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f8163f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5933:x1870603522935552:12345-0@lo:253: 20000000:01000000:1.0:1783946617.569386:0:5949:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783946617.569399:0:5949:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783946617.576306:0:5949:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783946617.576325:0:5949:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783946617.576498:0:5972:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783946617.576504:0:5972:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783946617.576526:0:5972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.576549:0:5972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db6ff3 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.576557:0:5972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.576606:0:5972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db6ff3 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946617.576622:0:5972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db6ff3 expref: 12 pid: 5949 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946617.576650:0:5972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001fe4fdda pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5972:1870603522935680:0@lo:104: 00000100:00100000:0.0:1783946617.576727:0:5972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946617.576778:0:5972:0:(client.c:2702:ptlrpc_set_wait()) set 00000000053d6d25 going to sleep for 11 seconds 00000100:00100000:1.0:1783946617.576950:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f8163f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5933:x1870603522935552:12345-0@lo:253: Request processed in 7595us (7957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946617.576962:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783946617.577090:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522935680 00000100:00100000:2.0:1783946617.577101:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522935680 00000100:00100000:2.0:1783946617.577155:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946617.577180:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079eca513 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5972:x1870603522935680:12345-0@lo:104: 00010000:00010000:2.0:1783946617.577205:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.577266:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783946617.577271:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079eca513 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5972:x1870603522935680:12345-0@lo:104: Request processed in 93us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946617.577278:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783946617.577297:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946617.577303:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.577312:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a2d9641 already unused, calling callback (00000000b04df7e7) 10000000:00010000:2.0:1783946617.577315:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.577324:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946617.577332:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946617.577350:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946617.577387:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.577394:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946617.577412:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.577419:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 000000004a2d9641/0x229d2ec450db6ff3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db6ffa expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.577438:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946617.577440:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946617.577441:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946617.577600:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946617.577613:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000bd55a7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522935808:0@lo:103: 00000100:00100000:1.0:1783946617.577654:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946617.577717:0:5972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001fe4fdda pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5972:1870603522935680:0@lo:104: 00010000:00010000:1.0:1783946617.577742:0:5972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946617.577929:0:5933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000191181d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:5933:1870603522935552:0@lo:253: 10000000:01000000:3.0:1783946617.577942:0:5933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783946617.577946:0:5933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783946617.577948:0:5933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783946617.577950:0:5933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946617.577951:0:5933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783946617.577960:0:5933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946617.577961:0:5933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946617.577962:0:5933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783946617.577964:0:5933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783946617.577966:0:5933:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783946617.577967:0:5933:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783946617.577969:0:5933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946617.577970:0:5933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783946617.577985:0:5933:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1783946617.578250:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522935808 00000100:00100000:2.0:1783946617.578256:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522935808 00010000:00010000:2.0:1783946617.578279:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db6ff3 expref: 12 pid: 5949 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946617.578304:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946617.578312:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec9ef761 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3447:x1870603522935808:12345-0@lo:103: 00010000:00010000:2.0:1783946617.578326:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946617.578331:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db6ff3 expref: 12 pid: 5949 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578344:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db6ff3 expref: 12 pid: 5949 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578360:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067b640e2/0x229d2ec450db6ffa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db6ff3 expref: 12 pid: 5949 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578383:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578391:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783946617.578406:0:5941:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001903564s 00010000:00010000:2.0:1783946617.578410:0:5941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578416:0:5941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578423:0:5941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578430:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578436:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001137b208 already unused, calling callback (0000000001d9f768) 00010000:00010000:2.0:1783946617.578440:0:5941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578447:0:5941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578462:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578473:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946617.578519:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec9ef761 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:3447:x1870603522935808:12345-0@lo:103: Request processed in 208us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946617.578527:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946617.578555:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000bd55a7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522935808:0@lo:103: 00010000:00010000:2.0:1783946617.578572:0:5972:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578578:0:5972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946617.578583:0:5972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001137b208/0x229d2ec450db702b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1783946617.587551:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1783946617.587982:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783946617.588258:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1783946617.588433:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783946617.588891:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1783946617.589452:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1783946617.591900:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1783946617.593827:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1783946617.594559:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1783946617.594803:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1783946617.595016:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1783946617.595707:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1783946617.599498:0:5933:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783946617.613386:0:5933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1783946617.613757:0:5989:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783946617.615827:0:5933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783946617.615961:0:5933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783946617.616538:0:5933:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783946617.616546:0:5933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783946617.618463:0:5933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1783946617.619577:0:5988:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1783946617.619592:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1783946617.621994:0:5989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783946617.626879:0:5933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783946617.627626:0:5933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783946617.630815:0:5933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783946617.631840:0:5933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783946617.632154:0:5933:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:0.0:1783946617.633292:0:5989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783946617.633383:0:5989:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783946617.633388:0:5989:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1783946617.636250:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783946617.636504:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783946617.636634:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783946617.637557:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783946617.637784:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1783946617.637982:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783946617.639055:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783946617.639364:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783946617.639525:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783946617.639799:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783946617.642468:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783946617.642630:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783946617.642844:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783946617.642991:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783946617.643841:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783946617.643972:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783946617.644575:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783946617.644800:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783946617.644937:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783946617.645123:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783946617.645537:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783946617.645776:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783946617.645897:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783946617.646017:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783946617.647198:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783946617.647948:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783946617.648123:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783946617.648967:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1783946617.651200:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783946617.651436:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783946617.651568:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783946617.651705:0:5933:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783946617.651931:0:5933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1783946617.659270:0:5933:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783946617.659319:0:5933:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5c981c7f988 00100000:10000000:0.0:1783946617.659329:0:5933:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783946617.660390:0:5933:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783946617.660408:0:5933:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783946617.660427:0:5933:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783946617.660481:0:5933:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783946617.661309:0:5933:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783946617.661472:0:5933:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783946618.002895:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946619.024607:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946620.049694:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946621.072873:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946622.096492:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783946622.355635:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783946622.355645:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff913786178000 from 3 10000000:01000000:0.0:1783946622.355651:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783946622.355711:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 0000000007161d57/0x229d2ec450db7032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946622.355726:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 0000000007161d57/0x229d2ec450db7032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946622.355738:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 0000000007161d57/0x229d2ec450db7032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946622.355765:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000725df32 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522935936:0@lo:101: 00000100:00100000:0.0:1783946622.355850:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946622.355923:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set 000000005ed6a49e going to sleep for 11 seconds 00000100:00100000:3.0:1783946622.357396:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522935936 00000100:00100000:3.0:1783946622.357410:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522935936 00000100:00100000:3.0:1783946622.357487:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783946622.357498:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3f8d147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:5953:x1870603522935936:12345-0@lo:101: 00010000:00010000:3.0:1783946622.357520:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946622.357539:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd1b326a/0x229d2ec450db7039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7032 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946622.357571:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd1b326a/0x229d2ec450db7039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7032 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946622.357583:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd1b326a/0x229d2ec450db7039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7032 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946622.357594:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd1b326a, rc 0) 00000100:00100000:3.0:1783946622.357673:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3f8d147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522935936:12345-0@lo:101: Request processed in 177us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946622.357680:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783946622.357736:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000725df32 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522935936:0@lo:101: 00010000:00010000:3.0:1783946622.357754:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 0000000007161d57/0x229d2ec450db7032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946622.357764:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 0000000007161d57/0x229d2ec450db7032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946622.357824:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000191181d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522936064:0@lo:256: 00000100:00100000:3.0:1783946622.357872:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946622.357901:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2d55b24 going to sleep for 11 seconds 00000100:00100000:3.0:1783946622.357916:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522936064 00000100:00100000:3.0:1783946622.357920:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522936064 00000100:00100000:3.0:1783946622.357942:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783946622.357947:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0c140a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522936064:12345-0@lo:256: 20000000:01000000:3.0:1783946622.357962:0:5949:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783946622.357978:0:5949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783946622.357981:0:5949:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783946622.358056:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0c140a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522936064:12345-0@lo:256: Request processed in 108us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946622.358103:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783946622.358134:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000191181d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522936064:0@lo:256: 10000000:01000000:3.0:1783946622.358170:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783946622.358176:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 0000000007161d57/0x229d2ec450db7032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946622.358193:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 0000000007161d57/0x229d2ec450db7032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783946622.869416:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783946622.869427:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783946622.869430:0:37:0:(import.c:65:import_set_state_nolock()) 000000000765c965 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783946622.869444:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000765c965 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946622.869503:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a490704f x1870603522936192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783946622.869538:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a490704f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603522936192:0@lo:38: 00000100:00100000:0.0:1783946622.869626:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946622.870315:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522936192 00000100:00100000:2.0:1783946622.870326:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522936192 00000100:00100000:2.0:1783946622.870364:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946622.870372:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8b9d0d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3446:x1870603522936192:12345-0@lo:38: 00010000:00080000:2.0:1783946622.870402:0:5958:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1783946622.870439:0:5958:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x229d2ec450db7040 00000004:00100000:2.0:1783946622.870615:0:5958:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783946622.870743:0:5958:0:(import.c:65:import_set_state_nolock()) 000000004215c570 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783946622.870928:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8b9d0d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1870603522936192:12345-0@lo:38: Request processed in 556us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946622.870936:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783946622.871152:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a490704f x1870603522936192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783946632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783946622.871173:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783946622.871180:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783946622.871185:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783946622.871187:0:3446:0:(import.c:65:import_set_state_nolock()) 000000000765c965 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783946622.871192:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a490704f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603522936192:0@lo:38: 00010000:00010000:1.0:1783946623.124683:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946624.147156:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783946624.357264:0:6234:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783946625.168342:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783946625.723413:0:6286:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783946625.723809:0:6286:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783946626.193389:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946627.216433:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946627.990209:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000bd55a7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522936320:0@lo:400: 00000100:00100000:3.0:1783946627.990291:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946627.990386:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946627.990393:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c0cd020 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522936448:0@lo:400: 00000100:00100000:3.0:1783946627.990425:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946627.990562:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522936448 00000100:00100000:2.0:1783946627.990572:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522936448 00000100:00100000:2.0:1783946627.990641:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946627.990650:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000191181d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522936448:12345-0@lo:400: 00000100:00100000:2.0:1783946627.990713:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000191181d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522936448:12345-0@lo:400: Request processed in 64us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946627.990737:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946627.990873:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522936320 00000100:00100000:0.0:1783946627.990878:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522936320 00000100:00100000:0.0:1783946627.990919:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783946627.990925:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d99b4f06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3449:x1870603522936320:12345-0@lo:400: 00000100:00100000:0.0:1783946627.990959:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d99b4f06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3449:x1870603522936320:12345-0@lo:400: Request processed in 35us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946627.990965:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1783946627.991191:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009c0cd020 x1870603522936448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946627.991208:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c0cd020 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522936448:0@lo:400: 00000100:00100000:3.0:1783946627.991219:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000bd55a7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522936320:0@lo:400: 00010000:00010000:3.0:1783946628.242174:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946629.264305:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783946629.524396:0:6388:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783946629.525447:0:6388:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783946630.289248:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783946631.142984:0:6437:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbbb924d0 20000000:00000080:2.0:1783946631.143007:0:6437:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9137b9dd5000 uarg=0000000000000000 20000000:01000000:2.0:1783946631.143055:0:6437:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783946631.143098:0:6437:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783946631.143105:0:6437:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783946631.143242:0:6437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1783946631.143257:0:6437:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1783946631.151118:0:6437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783946631.151372:0:6437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783946631.151409:0:6437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1783946631.151425:0:6437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1783946631.151445:0:6437:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783946631.151466:0:6437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946631.151487:0:6437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7001 expref: 11 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946631.151496:0:6437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946631.151550:0:6437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7001 expref: 11 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946631.151566:0:6437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7001 expref: 11 pid: 5949 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946631.151584:0:6437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dec24b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6437:1870603522936576:0@lo:104: 00000100:00100000:2.0:1783946631.151657:0:6437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946631.151724:0:6437:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d5804124 going to sleep for 11 seconds 00000100:00100000:3.0:1783946631.152386:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522936576 00000100:00100000:3.0:1783946631.152396:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522936576 00000100:00100000:3.0:1783946631.152447:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783946631.152456:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b00c0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:6437:x1870603522936576:12345-0@lo:104: 00010000:00010000:3.0:1783946631.152471:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946631.152555:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783946631.152561:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b00c0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:6437:x1870603522936576:12345-0@lo:104: Request processed in 107us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946631.152587:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783946631.152753:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946631.152761:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.152768:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e9736ec already unused, calling callback (00000000b04df7e7) 10000000:00010000:1.0:1783946631.152772:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.152780:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946631.152787:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946631.152805:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783946631.152848:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.152854:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946631.152876:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.152883:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 000000004e9736ec/0x229d2ec450db7001 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7008 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.152900:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946631.152901:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946631.152903:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946631.152915:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000609578e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522936704:0@lo:103: 00000100:00100000:1.0:1783946631.152975:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946631.153029:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522936704 00000100:00100000:1.0:1783946631.153034:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522936704 00010000:00010000:1.0:1783946631.153056:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7001 expref: 12 pid: 5949 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946631.153149:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783946631.153155:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8369f21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3447:x1870603522936704:12345-0@lo:103: 00010000:00010000:1.0:1783946631.153167:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946631.153172:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7001 expref: 12 pid: 5949 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153182:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7001 expref: 12 pid: 5949 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153207:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153216:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153230:0:5941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153236:0:5941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153242:0:5941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153247:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153252:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe36a14b already unused, calling callback (0000000001d9f768) 00010000:00010000:1.0:1783946631.153256:0:5941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153262:0:5941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153272:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946631.153281:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946631.153312:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8369f21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3447:x1870603522936704:12345-0@lo:103: Request processed in 157us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946631.153328:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783946631.153368:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000609578e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522936704:0@lo:103: 00010000:00010000:0.0:1783946631.153543:0:6437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7008 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7001 expref: 11 pid: 5949 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946631.153554:0:6437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dec24b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6437:1870603522936576:0@lo:104: 00010000:00010000:0.0:1783946631.153581:0:6437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946631.153590:0:6437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946631.153596:0:6437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946631.153602:0:6437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fe36a14b/0x229d2ec450db7047 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946631.312248:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783946632.272236:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783946632.272247:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff913786178000 from 1 10000000:01000000:3.0:1783946632.272254:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783946632.272314:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 000000008f34ae36/0x229d2ec450db704e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946632.272329:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 000000008f34ae36/0x229d2ec450db704e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946632.272342:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 000000008f34ae36/0x229d2ec450db704e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946632.272371:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a76efed0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522936832:0@lo:101: 00000100:00100000:3.0:1783946632.272444:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946632.272537:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set 0000000094081f13 going to sleep for 11 seconds 00000100:00100000:0.0:1783946632.275758:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522936832 00000100:00100000:0.0:1783946632.275776:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522936832 00000100:00100000:0.0:1783946632.275877:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783946632.275888:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abf45d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:5953:x1870603522936832:12345-0@lo:101: 00010000:00010000:0.0:1783946632.275927:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946632.275950:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7055 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db704e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946632.275978:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db704e expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946632.275989:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000027b3fcfd/0x229d2ec450db7055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db704e expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946632.275998:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000027b3fcfd, rc 0) 00000100:00100000:0.0:1783946632.276102:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abf45d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522936832:12345-0@lo:101: Request processed in 217us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946632.276110:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783946632.276245:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a76efed0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522936832:0@lo:101: 00010000:00010000:1.0:1783946632.276264:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 000000008f34ae36/0x229d2ec450db704e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946632.276272:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 000000008f34ae36/0x229d2ec450db704e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946632.276351:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000609578e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522936960:0@lo:501: 00000100:00100000:1.0:1783946632.276381:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946632.276889:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086f2e0db going to sleep for 11 seconds 00000100:00100000:3.0:1783946632.279917:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522936960 00000100:00100000:3.0:1783946632.279930:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522936960 00000100:00100000:3.0:1783946632.279978:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783946632.279987:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9f136ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522936960:12345-0@lo:501: 00000100:00100000:3.0:1783946632.280180:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9f136ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522936960:12345-0@lo:501: Request processed in 194us (3798us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946632.280188:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783946632.280379:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000609578e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522936960:0@lo:501: 00000100:00100000:1.0:1783946632.280437:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000609578e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522937088:0@lo:503: 00000100:00100000:1.0:1783946632.280484:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946632.280518:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086f2e0db going to sleep for 11 seconds 00000100:00100000:3.0:1783946632.284319:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522937088 00000100:00100000:3.0:1783946632.284333:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522937088 00000100:00100000:3.0:1783946632.284381:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783946632.284387:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048e5b668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522937088:12345-0@lo:503: 00000100:00100000:3.0:1783946632.284536:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048e5b668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522937088:12345-0@lo:503: Request processed in 149us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946632.284550:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783946632.284625:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000609578e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522937088:0@lo:503: 00000100:00100000:1.0:1783946632.291157:0:6463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a8edd72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:6463:1870603522937216:0@lo:502: 00000100:00100000:1.0:1783946632.291241:0:6463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946632.291283:0:6463:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086f2e0db going to sleep for 11 seconds 00000100:00100000:3.0:1783946632.291523:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522937216 00000100:00100000:3.0:1783946632.291529:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522937216 00000100:00100000:3.0:1783946632.291576:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783946632.291584:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004af8a29b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6463:x1870603522937216:12345-0@lo:502: 00000100:00100000:3.0:1783946632.291712:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004af8a29b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6463:x1870603522937216:12345-0@lo:502: Request processed in 129us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946632.291719:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783946632.291943:0:6463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a8edd72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:6463:1870603522937216:0@lo:502: 00000020:01000000:1.0:1783946632.291974:0:6463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783946632.291984:0:6463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946632.291986:0:6463:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783946632.291993:0:6463:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff913786178000 00000020:00000080:1.0:1783946632.291995:0:6463:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783946632.292042:0:6463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:6463:1870603522937344:0@lo:502: 00000100:00100000:1.0:1783946632.292112:0:6463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946632.292139:0:6463:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f180 going to sleep for 11 seconds 00000100:00100000:3.0:1783946632.292289:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522937344 00000100:00100000:3.0:1783946632.292294:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522937344 00000100:00100000:3.0:1783946632.292329:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783946632.292336:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6463:x1870603522937344:12345-0@lo:502: 00000100:00100000:3.0:1783946632.292404:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6463:x1870603522937344:12345-0@lo:502: Request processed in 69us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946632.292409:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783946632.292485:0:6463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:6463:1870603522937344:0@lo:502: 00000020:01000000:1.0:1783946632.292502:0:6463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946632.292507:0:6463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946632.292509:0:6463:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783946632.292512:0:6463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1783946632.292621:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783946632.292649:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783946632.292660:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946632.292672:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946632.336298:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946633.108460:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783946633.108489:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522937600:0@lo:400: 00000100:00100000:0.0:1783946633.108582:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946633.108643:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522937600 00000100:00100000:0.0:1783946633.108650:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522937600 00000100:00100000:0.0:1783946633.108700:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783946633.108708:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522937600:12345-0@lo:400: 00000100:00100000:0.0:1783946633.108760:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522937600:12345-0@lo:400: Request processed in 53us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946633.108769:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783946633.108808:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9137a3500a80 x1870603522937600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946633.108822:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522937600:0@lo:400: 00000100:00100000:1.0:1783946633.110483:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946633.110516:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522937472:0@lo:400: 00000100:00100000:1.0:1783946633.110593:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946633.112479:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522937472 00000100:00100000:0.0:1783946633.112512:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522937472 00000100:00100000:0.0:1783946633.112592:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783946633.112602:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3447:x1870603522937472:12345-0@lo:400: 00000100:00100000:0.0:1783946633.112688:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3447:x1870603522937472:12345-0@lo:400: Request processed in 87us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946633.112695:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783946633.112773:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522937472:0@lo:400: 00010000:00010000:2.0:1783946633.360418:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946634.385843:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946635.411286:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946636.433290:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946637.456370:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946638.224320:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522937856:0@lo:400: 00000100:00100000:0.0:1783946638.224398:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946638.224503:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522937728:0@lo:400: 00000100:00100000:3.0:1783946638.224539:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946638.224606:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522937856 00000100:00100000:3.0:1783946638.224613:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522937856 00000100:00100000:3.0:1783946638.224666:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783946638.224758:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522937856:12345-0@lo:400: 00000100:00100000:3.0:1783946638.224827:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522937856:12345-0@lo:400: Request processed in 72us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946638.224835:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783946638.224882:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9137a3500a80 x1870603522937856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946638.224898:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522937856:0@lo:400: 00000100:00100000:0.0:1783946638.225244:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522937728 00000100:00100000:0.0:1783946638.225250:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522937728 00000100:00100000:0.0:1783946638.225280:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783946638.225287:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3450:x1870603522937728:12345-0@lo:400: 00000100:00100000:0.0:1783946638.225334:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3450:x1870603522937728:12345-0@lo:400: Request processed in 47us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946638.225340:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783946638.226031:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522937728:0@lo:400: 00010000:00010000:1.0:1783946638.485571:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946639.507287:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946640.530980:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946641.559295:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946642.577794:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783946642.801909:0:6936:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783946642.801914:0:6936:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783946642.801915:0:6936:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783946642.802028:0:6936:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9137b63de800 00000020:01000004:1.0:1783946642.813101:0:6936:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783946642.813123:0:6936:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783946642.813146:0:6936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9137b9cfb380) 00000020:00000080:1.0:1783946642.813168:0:6936:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783946642.884705:0:6936:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783946642.888028:0:6936:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1783946642.927919:0:6936:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783946642.928609:0:6936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783946642.928620:0:6936:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783946642.928632:0:6936:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x229d2ec450db7063 00000020:01000004:0.0:1783946642.929004:0:6936:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783946642.929027:0:6936:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783946642.929813:0:6936:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783946642.929825:0:6936:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783946642.929830:0:6936:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783946642.929845:0:6936:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9137b65e19c0) 00000020:00000080:0.0:1783946642.929857:0:6936:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1783946642.933565:0:6936:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946642.935006:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783946642.935015:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783946642.942675:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783946642.942692:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783946642.943886:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783946642.943895:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783946642.946132:0:6936:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946642.946307:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783946642.946315:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783946642.952737:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783946642.952760:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783946643.007452:0:6936:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783946643.007759:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783946643.007767:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783946643.010791:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783946643.010810:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783946643.014962:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783946643.014983:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783946643.021934:0:6936:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946643.025851:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783946643.025864:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783946643.028552:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783946643.028566:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783946643.123275:0:6936:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783946643.123481:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783946643.123488:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783946643.125566:0:6936:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783946643.125579:0:6936:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783946643.127976:0:6936:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783946643.128009:0:6936:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783946643.128016:0:6936:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783946643.160968:0:6936:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783946643.161032:0:6936:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1783946643.161037:0:6936:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783946643.161039:0:6936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783946643.161041:0:6936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946643.161046:0:6936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783946643.161048:0:6936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946643.161049:0:6936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946643.161050:0:6936:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783946643.161052:0:6936:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783946643.161053:0:6936:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783946643.161055:0:6936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946643.161368:0:6936:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783946643.161374:0:6936:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1783946643.161376:0:6936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783946643.161377:0:6936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783946643.161379:0:6936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946643.161380:0:6936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783946643.161381:0:6936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946643.161381:0:6936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946643.161382:0:6936:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783946643.161384:0:6936:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783946643.161384:0:6936:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783946643.161385:0:6936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946643.161386:0:6936:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783946643.161418:0:6936:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783946643.161440:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522937984:0@lo:253: 00000100:00100000:3.0:1783946643.161526:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946643.161948:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4b1fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.162019:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522937984 00000100:00100000:1.0:1783946643.162028:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522937984 00000100:00100000:1.0:1783946643.162394:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783946643.162406:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522937984:12345-0@lo:253: 20000000:01000000:1.0:1783946643.162467:0:5951:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783946643.162472:0:5951:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1783946643.162478:0:5951:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1783946643.162481:0:5951:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1783946643.162779:0:5951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783946643.162924:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1783946643.162939:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1783946643.162956:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1783946643.162962:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1783946643.162973:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1783946643.162987:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1783946643.163115:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1783946643.163130:0:5951:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:1.0:1783946643.163132:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:1.0:1783946643.163145:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1783946643.163151:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783946643.163163:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1783946643.163168:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:1.0:1783946643.163179:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1783946643.163185:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783946643.163196:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1783946643.163285:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1783946643.163657:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1783946643.163670:0:5951:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:1.0:1783946643.163671:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:1.0:1783946643.163686:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1783946643.163692:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783946643.163707:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1783946643.163712:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:1.0:1783946643.163737:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1783946643.163745:0:5951:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783946643.163771:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1783946643.163789:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1783946643.163801:0:5951:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783946643.163804:0:5951:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783946643.163808:0:5951:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783946643.163866:0:5951:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783946643.163869:0:5951:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783946643.164469:0:6955:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1783946643.164493:0:6955:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1783946643.164526:0:6955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1783946643.164733:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1783946643.164754:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1783946643.164771:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1783946643.164780:0:5951:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783946643.164782:0:5951:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783946643.166366:0:6956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1783946643.171091:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1783946643.171135:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1783946643.171155:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1783946643.171170:0:5951:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783946643.171174:0:5951:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783946643.172456:0:6957:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1783946643.172494:0:6957:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1783946643.172511:0:6957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1783946643.172875:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1783946643.172899:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1783946643.172923:0:5951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1783946643.172941:0:5951:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783946643.172965:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.172984:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91378151ba00/0x229d2ec450db6f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db6f83 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.172992:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913797622c00/0x229d2ec450db6fa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db6f9f expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.172999:0:5951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91378151bc00/0x229d2ec450db7016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db700f expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.173020:0:5951:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.173360:0:5951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91378151bc00/0x229d2ec450db7016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db700f expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.173377:0:5951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91378151bc00/0x229d2ec450db7016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db700f expref: 12 pid: 5950 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946643.173392:0:5951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5951:1870603522938112:0@lo:104: 00000100:00100000:2.0:1783946643.173458:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783946643.173931:0:5951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913797622c00/0x229d2ec450db6fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db6f9f expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.173941:0:5951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff913797622c00/0x229d2ec450db6fa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db6f9f expref: 12 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946643.173951:0:5951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5951:1870603522938240:0@lo:104: 00000100:00100000:2.0:1783946643.173979:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783946643.174119:0:5951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91378151ba00/0x229d2ec450db6f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db6f83 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.174129:0:5951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91378151ba00/0x229d2ec450db6f8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db6f83 expref: 12 pid: 5949 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946643.174139:0:5951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5951:1870603522938368:0@lo:104: 00000100:00100000:2.0:1783946643.174162:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946643.174419:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522938112 00000100:00100000:0.0:1783946643.174428:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522938112 00000100:00100000:0.0:1783946643.174469:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522938240 00000100:00100000:0.0:1783946643.174472:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522938240 00000100:00100000:0.0:1783946643.174487:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946643.174496:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:5951:x1870603522938112:12345-0@lo:104: 00010000:00010000:0.0:1783946643.174511:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913797622200/0x229d2ec450db700f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946643.174562:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783946643.174569:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:5951:x1870603522938112:12345-0@lo:104: Request processed in 73us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946643.174576:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946643.174609:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783946643.174615:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5951:x1870603522938240:12345-0@lo:104: 00010000:00010000:0.0:1783946643.174622:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db6f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.174801:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946643.174811:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797622200/0x229d2ec450db700f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.174820:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622200 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946643.174824:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797622200/0x229d2ec450db700f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.174833:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797622200/0x229d2ec450db700f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946643.174840:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797622200/0x229d2ec450db700f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946643.174846:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946643.174899:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913797622200/0x229d2ec450db700f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.174907:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946643.174929:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797622200/0x229d2ec450db700f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.174947:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797622200/0x229d2ec450db700f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7016 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.174965:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946643.174966:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946643.174968:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946643.174995:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522938496:0@lo:103: 00000100:00100000:1.0:1783946643.175045:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.175126:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522938496 00000100:00100000:1.0:1783946643.175130:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522938496 00010000:00010000:1.0:1783946643.175153:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91378151bc00/0x229d2ec450db7016 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db700f expref: 13 pid: 5950 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946643.175178:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783946643.175185:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3448:x1870603522938496:12345-0@lo:103: 00010000:00010000:1.0:1783946643.175197:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946643.175270:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91378151bc00/0x229d2ec450db7016 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db700f expref: 13 pid: 5950 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.175282:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91378151bc00/0x229d2ec450db7016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db700f expref: 13 pid: 5950 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.175375:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946643.175407:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3448:x1870603522938496:12345-0@lo:103: Request processed in 222us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.175415:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783946643.175455:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522938496:0@lo:103: 00010000:00010000:0.0:1783946643.175777:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783946643.175783:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5951:x1870603522938240:12345-0@lo:104: Request processed in 1168us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946643.175790:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1783946643.180610:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946643.180636:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db6f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.180653:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946643.180658:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db6f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.180672:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db6f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946643.180680:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db6f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946643.180686:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946643.180761:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db6f9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.180768:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946643.180795:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db6f9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.180803:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db6f9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db6fa6 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.180821:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946643.180823:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946643.180824:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946643.180842:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522938624:0@lo:103: 00000100:00100000:1.0:1783946643.180905:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.180974:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522938624 00000100:00100000:1.0:1783946643.180981:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522938624 00010000:00010000:1.0:1783946643.181007:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913797622c00/0x229d2ec450db6fa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db6f9f expref: 13 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946643.181032:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783946643.181040:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3449:x1870603522938624:12345-0@lo:103: 00010000:00010000:1.0:1783946643.181053:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946643.181078:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913797622c00/0x229d2ec450db6fa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db6f9f expref: 13 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.181090:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913797622c00/0x229d2ec450db6fa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db6f9f expref: 13 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.181107:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946643.181136:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3449:x1870603522938624:12345-0@lo:103: Request processed in 97us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.181143:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783946643.181179:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522938624:0@lo:103: 00000100:00100000:2.0:1783946643.181539:0:5951:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd780 going to sleep for 11 seconds 00010000:00010000:2.0:1783946643.181554:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91378151bc00/0x229d2ec450db7016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db700f expref: 12 pid: 5950 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946643.181571:0:5951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5951:1870603522938112:0@lo:104: 00010000:00010000:2.0:1783946643.181582:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622c00/0x229d2ec450db6fa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db6f9f expref: 11 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946643.181590:0:5951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5951:1870603522938240:0@lo:104: 00000100:00100000:0.0:1783946643.181650:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522938368 00000100:00100000:0.0:1783946643.181655:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522938368 00000100:00100000:0.0:1783946643.181678:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783946643.181684:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5951:x1870603522938368:12345-0@lo:104: 00010000:00010000:0.0:1783946643.181695:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db6f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946643.181755:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783946643.181761:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5951:x1870603522938368:12345-0@lo:104: Request processed in 77us (7598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946643.181767:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783946643.181853:0:5951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5951:1870603522938368:0@lo:104: 00010000:00010000:2.0:1783946643.181871:0:5951:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.181908:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946643.181913:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db6f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.181920:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946643.181924:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db6f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.181932:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db6f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946643.181949:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db6f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946643.181954:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946643.181981:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db6f83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.181986:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946643.182003:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db6f83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182011:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db6f83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db6f8a expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182023:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946643.182025:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946643.182026:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946643.182031:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783946643.182039:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522938752:0@lo:103: 00000100:00100000:1.0:1783946643.182091:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.182114:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522938752 00000100:00100000:1.0:1783946643.182117:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522938752 00010000:00010000:1.0:1783946643.182129:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91378151ba00/0x229d2ec450db6f8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db6f83 expref: 11 pid: 5949 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946643.182144:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783946643.182150:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:3449:x1870603522938752:12345-0@lo:103: 00010000:00010000:1.0:1783946643.182171:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946643.182175:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91378151ba00/0x229d2ec450db6f8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db6f83 expref: 11 pid: 5949 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182188:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91378151ba00/0x229d2ec450db6f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db6f83 expref: 11 pid: 5949 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182199:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91378151ba00/0x229d2ec450db6f8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db6f83 expref: 11 pid: 5949 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182222:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182230:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182244:0:5942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182251:0:5942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182258:0:5942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182265:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182270:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623c00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946643.182274:0:5942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182281:0:5942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182301:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182310:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946643.182332:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+10:3449:x1870603522938752:12345-0@lo:103: Request processed in 182us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.182338:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783946643.182361:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522938752:0@lo:103: 00010000:00010000:1.0:1783946643.182373:0:5951:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182380:0:5951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.182387:0:5951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797623c00/0x229d2ec450db7071 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783946643.182397:0:5951:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783946643.187032:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:6936:x1870603522937984:12345-0@lo:253: Request processed in 24614us (25490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946643.187051:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783946643.187357:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522937984:0@lo:253: 10000000:01000000:3.0:1783946643.187375:0:6936:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783946643.187378:0:6936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783946643.187380:0:6936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783946643.187381:0:6936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946643.187382:0:6936:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1783946643.187384:0:6936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946643.187385:0:6936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946643.187386:0:6936:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783946643.187388:0:6936:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783946643.187390:0:6936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946643.187392:0:6936:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783946643.187414:0:6936:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9137b63de800 from lustre-OST0000 10000000:01000000:3.0:1783946643.187463:0:6936:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783946643.187466:0:6936:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783946643.187475:0:6936:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9137909d0000 local copy 10000000:01000000:3.0:1783946643.187480:0:6936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783946643.187523:0:6936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946643.187533:0:6936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946643.187543:0:6936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946643.187560:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522938880:0@lo:101: 00000100:00100000:3.0:1783946643.187612:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946643.187684:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4b1f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946643.187975:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522938880 00000100:00100000:0.0:1783946643.187984:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522938880 00000100:00100000:0.0:1783946643.188038:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783946643.188049:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:6936:x1870603522938880:12345-0@lo:101: 00010000:00010000:0.0:1783946643.188092:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946643.188111:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913780031200/0x229d2ec450db707f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7078 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946643.188136:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913780031200/0x229d2ec450db707f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7078 expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946643.188156:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913780031200/0x229d2ec450db707f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7078 expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946643.188167:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031200, rc 0) 00000100:00100000:0.0:1783946643.188322:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+10:6936:x1870603522938880:12345-0@lo:101: Request processed in 273us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946643.188329:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783946643.188387:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522938880:0@lo:101: 00010000:00010000:2.0:1783946643.188402:0:6936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.188411:0:6936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946643.188503:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939008:0@lo:501: 00000100:00100000:2.0:1783946643.188530:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946643.188603:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cda80 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.189585:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522939008 00000100:00100000:1.0:1783946643.189594:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522939008 00000100:00100000:1.0:1783946643.191014:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783946643.191034:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+10:6936:x1870603522939008:12345-0@lo:501: 00000100:00100000:1.0:1783946643.191185:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+10:6936:x1870603522939008:12345-0@lo:501: Request processed in 157us (2653us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783946643.191340:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783946643.191411:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939008:0@lo:501: 10000000:01000000:1.0:1783946643.191436:0:6936:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783946643.191478:0:6936:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783946643.191487:0:6936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.191499:0:6936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.191507:0:6936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.191571:0:6936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783946643.191602:0:6936:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9137b63de800 10000000:01000000:1.0:1783946643.191607:0:6936:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783946643.191612:0:6936:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9137909d0000 10000000:01000000:1.0:1783946643.191614:0:6936:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1783946643.191618:0:6936:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9137909d0000 from 1 10000000:01000000:1.0:1783946643.191620:0:6936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783946643.191654:0:6936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.191663:0:6936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.191673:0:6936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946643.191692:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939136:0@lo:101: 00000100:00100000:1.0:1783946643.191740:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.191784:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54240 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.191800:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522939136 00000100:00100000:1.0:1783946643.191814:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522939136 00000100:00100000:1.0:1783946643.191843:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783946643.191850:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+10:6936:x1870603522939136:12345-0@lo:101: 00010000:00010000:1.0:1783946643.191858:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946643.191871:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137c21d4200/0x229d2ec450db708d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7086 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.191893:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137c21d4200/0x229d2ec450db708d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7086 expref: 11 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.191905:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137c21d4200/0x229d2ec450db708d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7086 expref: 11 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.191915:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137c21d4200, rc 0) 00000100:00100000:1.0:1783946643.191944:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:6936:x1870603522939136:12345-0@lo:101: Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.191951:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783946643.191981:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939136:0@lo:101: 00010000:00010000:1.0:1783946643.191993:0:6936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db708d expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.192002:0:6936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db708d expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946643.192018:0:6936:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783946643.192028:0:6936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db708d expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.192036:0:6936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db708d expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946643.192049:0:6936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783946643.192052:0:6936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783946643.192080:0:6936:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783946643.192083:0:6936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783946643.192097:0:6936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.192104:0:6936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.192111:0:6936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946643.192121:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939264:0@lo:101: 00000100:00100000:1.0:1783946643.192144:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.192157:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54240 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.192170:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522939264 00000100:00100000:1.0:1783946643.192174:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522939264 00000100:00100000:1.0:1783946643.192191:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783946643.192357:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:6936:x1870603522939264:12345-0@lo:101: 00010000:00010000:1.0:1783946643.192365:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946643.192374:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7094 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.192387:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7094 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.192396:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7094 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.192409:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137c21d4e00, rc 0) 00000100:00100000:1.0:1783946643.192439:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522939264:12345-0@lo:101: Request processed in 85us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.192445:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783946643.192478:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939264:0@lo:101: 00010000:00010000:1.0:1783946643.192487:0:6936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.192495:0:6936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946643.192569:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939392:0@lo:501: 00000100:00100000:1.0:1783946643.192593:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.192607:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54240 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.192619:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522939392 00000100:00100000:1.0:1783946643.192623:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522939392 00000100:00100000:1.0:1783946643.192641:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783946643.192647:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522939392:12345-0@lo:501: 00000100:00100000:1.0:1783946643.193948:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522939392:12345-0@lo:501: Request processed in 1294us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.193961:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783946643.194030:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939392:0@lo:501: 00000100:00100000:1.0:1783946643.194093:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939520:0@lo:503: 00000100:00100000:1.0:1783946643.194147:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.194163:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54240 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.194186:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522939520 00000100:00100000:1.0:1783946643.195017:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522939520 00000100:00100000:1.0:1783946643.195183:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783946643.195205:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522939520:12345-0@lo:503: 00000100:00100000:1.0:1783946643.195349:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522939520:12345-0@lo:503: Request processed in 157us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.195357:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783946643.195415:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939520:0@lo:503: 00000040:00080000:1.0:1783946643.195796:0:6936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783946643.195894:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939648:0@lo:502: 00000100:00100000:1.0:1783946643.195936:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.195975:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54240 going to sleep for 11 seconds 00000100:00100000:3.0:1783946643.196095:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522939648 00000100:00100000:3.0:1783946643.196101:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522939648 00000100:00100000:3.0:1783946643.196141:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783946643.196149:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522939648:12345-0@lo:502: 00000100:00100000:3.0:1783946643.196247:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522939648:12345-0@lo:502: Request processed in 99us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946643.196255:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1783946643.196293:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946643.196304:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.196328:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151ae00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946643.196332:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.196342:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946643.196350:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946643.196357:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946643.196382:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.196388:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946643.196412:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.196421:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff91378151ae00/0x229d2ec450db7078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x229d2ec450db707f expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.196436:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946643.196437:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946643.196439:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946643.196516:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783946643.196529:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522939776:0@lo:103: 00000100:00100000:1.0:1783946643.196562:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.196612:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939648:0@lo:502: 00000040:00080000:1.0:1783946643.196934:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783946643.196965:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783946643.196979:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783946643.196992:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783946643.197005:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783946643.197018:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783946643.197039:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939904:0@lo:502: 00000100:00100000:1.0:1783946643.197113:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.197130:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f46480 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.197147:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522939904 00000100:00100000:1.0:1783946643.197153:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522939904 00000100:00100000:1.0:1783946643.197266:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783946643.197283:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522939904:12345-0@lo:502: 00000100:00100000:1.0:1783946643.197370:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522939904:12345-0@lo:502: Request processed in 89us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.197378:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783946643.197380:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522939904:0@lo:502: 00000040:00080000:3.0:1783946643.197418:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1783946643.197426:0:6936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:2.0:1783946643.197480:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522939776 00000100:00100000:2.0:1783946643.197484:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522939776 00000100:00100000:2.0:1783946643.197512:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946643.197518:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3448:x1870603522939776:12345-0@lo:103: 00010000:00010000:2.0:1783946643.197527:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946643.197550:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913780031200/0x229d2ec450db707f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db7078 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.197565:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946643.197594:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:3448:x1870603522939776:12345-0@lo:103: Request processed in 76us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946643.197600:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783946643.197850:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522939776:0@lo:103: 00000020:01000000:2.0:1783946643.198554:0:6958:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783946643.198563:0:6958:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1783946643.198570:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946643.198572:0:6958:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783946643.198577:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783946643.198592:0:6958:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9137a0733380) 00000020:00000080:2.0:1783946643.198612:0:6958:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783946643.198618:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783946643.198838:0:6958:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9137b63de800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783946643.198848:0:6958:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783946643.198855:0:6958:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x229d2ec450db70a9 00010000:00010000:3.0:1783946643.208476:0:6958:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1783946643.208834:0:6958:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1783946643.214154:0:6958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1783946643.214607:0:6958:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1783946643.223557:0:6958:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1783946643.223848:0:6958:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1783946643.232922:0:6958:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1783946643.241707:0:6958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783946643.241732:0:6958:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946643.241739:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946643.241742:0:6958:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783946643.241746:0:6958:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946643.243221:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946643.243224:0:6958:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783946643.243230:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783946643.243233:0:6958:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783946643.243271:0:6958:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946643.243275:0:6958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946643.243277:0:6958:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783946643.243280:0:6958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783946643.252158:0:6936:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1783946643.252216:0:6936:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783946643.252254:0:6936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.252268:0:6936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946643.252277:0:6936:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137b63de800 from 1 10000000:01000000:1.0:1783946643.252280:0:6936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783946643.252333:0:6936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.252341:0:6936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.252354:0:6936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946643.252386:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940032:0@lo:101: 00000100:00100000:1.0:1783946643.252467:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.252521:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780840 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.252552:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522940032 00000100:00100000:1.0:1783946643.252559:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522940032 00000100:00100000:1.0:1783946643.252612:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783946643.252621:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:6936:x1870603522940032:12345-0@lo:101: 00010000:00010000:1.0:1783946643.252636:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946643.252652:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db70b0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.252679:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db70b0 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.252690:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db70b0 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.252698:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137c21d5e00, rc 0) 00000100:00100000:1.0:1783946643.252749:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940032:12345-0@lo:101: Request processed in 128us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.252755:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783946643.252803:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940032:0@lo:101: 00010000:00010000:1.0:1783946643.252817:0:6936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.252825:0:6936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946643.252928:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940160:0@lo:501: 00000100:00100000:1.0:1783946643.252950:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.252963:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780840 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.252977:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522940160 00000100:00100000:1.0:1783946643.252981:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522940160 00000100:00100000:1.0:1783946643.253002:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783946643.253014:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940160:12345-0@lo:501: 00000100:00100000:1.0:1783946643.253147:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940160:12345-0@lo:501: Request processed in 133us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.253153:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783946643.253179:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940160:0@lo:501: 00000100:00100000:1.0:1783946643.253204:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940288:0@lo:503: 00000100:00100000:1.0:1783946643.253240:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.253253:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780840 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.253263:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522940288 00000100:00100000:1.0:1783946643.253266:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522940288 00000100:00100000:1.0:1783946643.253281:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783946643.253286:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940288:12345-0@lo:503: 00000100:00100000:1.0:1783946643.253363:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940288:12345-0@lo:503: Request processed in 75us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.253369:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783946643.253407:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940288:0@lo:503: 00000040:00080000:1.0:1783946643.253641:0:6936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783946643.253715:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940416:0@lo:502: 00000100:00100000:1.0:1783946643.253759:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.253773:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780840 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.253788:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522940416 00000100:00100000:1.0:1783946643.253792:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522940416 00000100:00100000:1.0:1783946643.253834:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783946643.253841:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940416:12345-0@lo:502: 00000100:00100000:1.0:1783946643.253915:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940416:12345-0@lo:502: Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.253930:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783946643.253967:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940416:0@lo:502: 00000040:00080000:1.0:1783946643.254161:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1783946643.254187:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1783946643.254206:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940544:0@lo:502: 00000100:00100000:1.0:1783946643.254237:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.254251:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780840 going to sleep for 11 seconds 00000100:00100000:1.0:1783946643.254263:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522940544 00000100:00100000:1.0:1783946643.254267:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522940544 00000100:00100000:1.0:1783946643.254284:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783946643.254290:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940544:12345-0@lo:502: 00000100:00100000:1.0:1783946643.254352:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940544:12345-0@lo:502: Request processed in 61us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946643.254358:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783946643.254393:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940544:0@lo:502: 00000040:00080000:1.0:1783946643.254427:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783946643.254435:0:6936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783946643.260421:0:6962:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783946643.260434:0:6962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946643.260436:0:6962:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783946643.260443:0:6962:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9137b63de800 00000020:00000080:3.0:1783946643.260445:0:6962:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783946643.260455:0:6962:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783946643.260458:0:6962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946643.260459:0:6962:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783946643.260462:0:6962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783946643.260610:0:6936:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783946643.260652:0:6936:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783946643.260675:0:6936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946643.260687:0:6936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946643.260744:0:6936:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783946643.260748:0:6936:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9137b63de800 10000000:01000000:0.0:1783946643.260757:0:6936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9137b63de800 10000000:01000000:0.0:1783946643.260761:0:6936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783946643.260766:0:6936:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9137b63de800 from 1 10000000:01000000:0.0:1783946643.260769:0:6936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783946643.260809:0:6936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946643.260818:0:6936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946643.260829:0:6936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946643.260859:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3500000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940672:0@lo:101: 00000100:00100000:0.0:1783946643.260934:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946643.260982:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fdd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946643.261138:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522940672 00000100:00100000:3.0:1783946643.261146:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522940672 00000100:00100000:3.0:1783946643.261187:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783946643.261196:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:6936:x1870603522940672:12345-0@lo:101: 00010000:00010000:3.0:1783946643.261211:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946643.261224:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db70be expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946643.261249:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db70be expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946643.261260:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db70be expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946643.261268:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151ac00, rc 0) 00000100:00100000:3.0:1783946643.261328:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522940672:12345-0@lo:101: Request processed in 133us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946643.261335:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783946643.261418:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3500000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940672:0@lo:101: 00010000:00010000:2.0:1783946643.261433:0:6936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.261442:0:6936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946643.261528:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940800:0@lo:501: 00000100:00100000:2.0:1783946643.261556:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946643.261568:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1783946643.261767:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522940800 00000100:00100000:0.0:1783946643.261772:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522940800 00000100:00100000:0.0:1783946643.261804:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783946643.261812:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522940800:12345-0@lo:501: 00000100:00100000:0.0:1783946643.261918:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522940800:12345-0@lo:501: Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946643.261924:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783946643.261984:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940800:0@lo:501: 00000100:00100000:2.0:1783946643.262011:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940928:0@lo:503: 00000100:00100000:2.0:1783946643.262052:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946643.262099:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1783946643.262140:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522940928 00000100:00100000:0.0:1783946643.262144:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522940928 00000100:00100000:0.0:1783946643.262170:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783946643.262176:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522940928:12345-0@lo:503: 00000100:00100000:0.0:1783946643.262243:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522940928:12345-0@lo:503: Request processed in 67us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946643.262258:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783946643.262325:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522940928:0@lo:503: 00000040:00080000:2.0:1783946643.262600:0:6936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783946643.262677:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522941056:0@lo:502: 00000100:00100000:2.0:1783946643.262709:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946643.262743:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946643.262761:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522941056 00000100:00100000:2.0:1783946643.262764:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522941056 00000100:00100000:2.0:1783946643.262783:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783946643.262789:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522941056:12345-0@lo:502: 00000100:00100000:2.0:1783946643.262867:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522941056:12345-0@lo:502: Request processed in 78us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946643.262873:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783946643.262909:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522941056:0@lo:502: 00000040:00080000:2.0:1783946643.263102:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783946643.263125:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783946643.263135:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783946643.263144:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783946643.263154:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783946643.263164:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783946643.263173:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783946643.263182:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783946643.263191:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783946643.263200:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783946643.263210:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783946643.263219:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783946643.263228:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783946643.263247:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783946643.263267:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783946643.263278:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783946643.263288:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783946643.263297:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783946643.263307:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783946643.263315:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783946643.263325:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783946643.263334:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783946643.263345:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783946643.263359:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783946643.263372:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1783946643.263384:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1783946643.263396:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1783946643.263410:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1783946643.263430:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522941184:0@lo:502: 00000100:00100000:2.0:1783946643.263466:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946643.263484:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946643.263501:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522941184 00000100:00100000:2.0:1783946643.263506:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522941184 00000100:00100000:2.0:1783946643.263527:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783946643.263533:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522941184:12345-0@lo:502: 00000100:00100000:2.0:1783946643.263609:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522941184:12345-0@lo:502: Request processed in 74us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946643.263615:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783946643.263655:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522941184:0@lo:502: 00000040:00080000:2.0:1783946643.263689:0:6936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1783946643.263697:0:6936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1783946643.264455:0:6963:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783946643.264471:0:6963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff913792764d40) 00000020:00000080:3.0:1783946643.264493:0:6963:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1783946643.264763:0:6963:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9137b63de800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783946643.264768:0:6963:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9137b63de800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783946643.264771:0:6963:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9137b63de800 3 00010000:00080000:3.0:1783946643.264798:0:6963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9137a7eee000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.118@tcp at head 00010000:00010000:3.0:1783946643.272106:0:6963:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1783946643.272240:0:6963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783946643.272293:0:6963:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783946643.272311:0:6963:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x229d2ec450db70d3 00000100:00080000:3.0:1783946643.272327:0:6963:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783946643.272480:0:6963:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9137a7eee000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1783946643.272612:0:6963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137b9ce4a80 x1870603522941312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783946643.272641:0:6963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783946643.272801:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522941440:0@lo:400: 00000100:00100000:1.0:1783946643.272831:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3446:1870603522941312:0@lo:38: 00000100:00100000:1.0:1783946643.272912:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946643.274222:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522941312 00000100:00100000:0.0:1783946643.274235:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522941312 00000100:00100000:0.0:1783946643.274284:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946643.274293:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3446:x1870603522941312:12345-0@lo:38: 00010000:00080000:0.0:1783946643.274319:0:5957:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:0.0:1783946643.274355:0:5957:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x229d2ec450db70da 00000040:00080000:2.0:1783946643.275246:0:6963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1783946643.275292:0:6936:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1783946643.275331:0:6936:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783946643.275346:0:6936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.275358:0:6936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783946643.275401:0:6936:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783946643.275403:0:6936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783946643.275404:0:6936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946643.275406:0:6936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946643.275407:0:6936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946643.275408:0:6936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946643.275410:0:6936:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946643.275412:0:6936:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783946643.275413:0:6936:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783946643.275415:0:6936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946643.275416:0:6936:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783946643.275420:0:6936:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1783946643.275422:0:6936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783946643.275424:0:6936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783946643.275425:0:6936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946643.275426:0:6936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946643.275427:0:6936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946643.275428:0:6936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946643.275429:0:6936:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946643.275430:0:6936:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783946643.275431:0:6936:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783946643.275432:0:6936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946643.275433:0:6936:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783946643.275454:0:6936:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783946643.275471:0:6936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522941568:0@lo:253: 00000004:00100000:0.0:1783946643.279423:0:5957:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783946643.279480:0:5957:0:(import.c:65:import_set_state_nolock()) ffff9137b9cd8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783946643.279604:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1870603522941312:12345-0@lo:38: Request processed in 5308us (6689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946643.279617:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783946643.280187:0:6936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946643.280221:0:6936:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd840 going to sleep for 11 seconds 00000100:00100000:2.0:1783946643.280249:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522941568 00000100:00100000:2.0:1783946643.280257:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522941568 00000100:00100000:2.0:1783946643.280312:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783946643.280326:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522941568:12345-0@lo:253: 20000000:01000000:2.0:1783946643.280352:0:5951:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783946643.280364:0:5951:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1783946643.280765:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9137b9ce4a80 x1870603522941312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783946653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946643.280778:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783946643.284941:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1783946643.284964:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783946643.284971:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783946643.284984:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137a7eee000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783946643.285001:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3446:1870603522941312:0@lo:38: 00000100:00100000:3.0:1783946643.289044:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946643.289125:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522941440 00000100:00100000:2.0:1783946643.289135:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522941440 00000100:00100000:2.0:1783946643.289191:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946643.289202:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522941440:12345-0@lo:400: 00000100:00100000:2.0:1783946643.289298:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522941440:12345-0@lo:400: Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946643.289306:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783946643.289450:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9137a3503b80 x1870603522941440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946643.289466:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522941440:0@lo:400: 20000000:01000000:2.0:1783946643.290522:0:5951:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783946643.290539:0:5951:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783946643.290864:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:6936:x1870603522941568:12345-0@lo:253: Request processed in 10542us (10676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946643.290874:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 20000000:01000000:1.0:1783946643.290988:0:5972:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783946643.290993:0:5972:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783946643.291013:0:5972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.291028:0:5972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91378151be00/0x229d2ec450db7039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7032 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.291036:0:5972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.291107:0:5972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91378151be00/0x229d2ec450db7039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7032 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946643.291121:0:5972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91378151be00/0x229d2ec450db7039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7032 expref: 12 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946643.291134:0:5972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5972:1870603522941696:0@lo:104: 00000100:00100000:1.0:1783946643.291169:0:5972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946643.291205:0:5972:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780840 going to sleep for 11 seconds 00000100:00100000:2.0:1783946643.291304:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522941696 00000100:00100000:2.0:1783946643.291311:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522941696 00000100:00100000:2.0:1783946643.291345:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783946643.291354:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5972:x1870603522941696:12345-0@lo:104: 00010000:00010000:2.0:1783946643.291368:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db7032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291412:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783946643.291418:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5972:x1870603522941696:12345-0@lo:104: Request processed in 66us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946643.291423:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783946643.291452:0:5972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5972:1870603522941696:0@lo:104: 00010000:00010000:2.0:1783946643.291483:0:5972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291499:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946643.291505:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db7032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291512:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946643.291516:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db7032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291524:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db7032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946643.291532:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db7032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946643.291538:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946643.291564:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db7032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291571:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946643.291588:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db7032 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291594:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db7032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7039 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291610:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946643.291612:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946643.291613:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946643.291635:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783946643.291659:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522941824:0@lo:103: 00000100:00100000:2.0:1783946643.291689:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946643.291730:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522941824 00000100:00100000:2.0:1783946643.291734:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522941824 00000100:00100000:3.0:1783946643.291739:0:6936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:6936:1870603522941568:0@lo:253: 10000000:01000000:3.0:1783946643.291749:0:6936:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00010000:00010000:2.0:1783946643.291751:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91378151be00/0x229d2ec450db7039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7032 expref: 13 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783946643.291753:0:6936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783946643.291755:0:6936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783946643.291756:0:6936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946643.291757:0:6936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783946643.291758:0:6936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946643.291765:0:6936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946643.291767:0:6936:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783946643.291769:0:6936:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783946643.291771:0:6936:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000100:00100000:2.0:1783946643.291771:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1783946643.291772:0:6936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946643.291774:0:6936:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783946643.291776:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3535050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3450:x1870603522941824:12345-0@lo:103: 00000020:02000000:3.0:1783946643.291785:0:6936:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1783946643.291902:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946643.291908:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91378151be00/0x229d2ec450db7039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7032 expref: 13 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291918:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91378151be00/0x229d2ec450db7039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7032 expref: 13 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291931:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91378151be00/0x229d2ec450db7039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7032 expref: 13 pid: 5951 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291944:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291952:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783946643.291965:0:5943:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001903564s 00010000:00010000:2.0:1783946643.291970:0:5943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291977:0:5943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291990:0:5943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.291997:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.292003:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137c21d5000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946643.292007:0:5943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.292015:0:5943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.292029:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.292136:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946643.292193:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3535050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3450:x1870603522941824:12345-0@lo:103: Request processed in 415us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946643.292200:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783946643.292286:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522941824:0@lo:103: 00010000:00010000:2.0:1783946643.292321:0:5972:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.292340:0:5972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946643.292348:0:5972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137c21d5000/0x229d2ec450db70e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1783946643.297741:0:6936:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783946643.298020:0:6936:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783946643.298230:0:6936:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783946643.298525:0:6936:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783946643.298912:0:6936:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783946643.299118:0:6936:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1783946643.300555:0:6936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1783946643.312790:0:6936:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783946643.312801:0:6936:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783946643.312961:0:6936:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783946643.313021:0:6936:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783946643.313047:0:6936:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783946643.313099:0:6936:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1783946643.317161:0:6936:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946643.317347:0:6936:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1783946643.602532:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783946644.437454:0:7018:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946644.438232:0:7018:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783946644.625195:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946645.648315:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946646.672257:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946647.696291:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946648.466553:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522942208:0@lo:400: 00000100:00100000:0.0:1783946648.466553:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522942080:0@lo:400: 00000100:00100000:2.0:1783946648.466625:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522941952:0@lo:400: 00000100:00100000:3.0:1783946648.469109:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946648.473303:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522942208 00000100:00100000:1.0:1783946648.473319:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522942208 00000100:00100000:1.0:1783946648.473416:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783946648.473417:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946648.473428:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522942208:12345-0@lo:400: 00000100:00100000:0.0:1783946648.473549:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946648.473672:0:5956:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783946648.473683:0:5956:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783946648.474258:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946648.474360:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522941952 00000100:00100000:3.0:1783946648.474366:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522941952 00000100:00100000:3.0:1783946648.474413:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783946648.474422:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3450:x1870603522941952:12345-0@lo:400: 00000100:00100000:3.0:1783946648.474478:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3450:x1870603522941952:12345-0@lo:400: Request processed in 57us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946648.474486:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783946648.474689:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522941952:0@lo:400: 00000100:00100000:1.0:1783946648.475825:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522942208:12345-0@lo:400: Request processed in 2394us (6719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946648.475837:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783946648.475860:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522942080 00000100:00100000:1.0:1783946648.475865:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522942080 00000100:00100000:1.0:1783946648.475892:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783946648.475898:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522942080:12345-0@lo:400: 00000100:00100000:1.0:1783946648.475931:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522942080:12345-0@lo:400: Request processed in 33us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946648.475937:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783946648.476030:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b9ce7b80 x1870603522942208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946648.476046:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522942208:0@lo:400: 00010000:00080000:0.0:1783946648.476783:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b9ce4000 x1870603522942080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946648.476794:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522942080:0@lo:400: 00010000:00010000:2.0:1783946648.721133:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946649.745957:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783946650.514156:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783946650.514165:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff913786178000 from 21 10000000:01000000:2.0:1783946650.514172:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783946650.514224:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946650.514237:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946650.514247:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946650.514273:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522942336:0@lo:101: 00000100:00100000:2.0:1783946650.514342:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946650.514385:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0738e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783946650.514415:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522942336 00000100:00100000:2.0:1783946650.514428:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522942336 00000100:00100000:2.0:1783946650.514480:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783946650.514492:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522942336:12345-0@lo:101: 00010000:00010000:2.0:1783946650.514507:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946650.514520:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db70e8 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946650.514544:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db70e8 expref: 13 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946650.514555:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db70e8 expref: 13 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946650.514564:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622200, rc 0) 00000100:00100000:2.0:1783946650.514617:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522942336:12345-0@lo:101: Request processed in 126us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946650.514623:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783946650.514675:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522942336:0@lo:101: 00010000:00010000:2.0:1783946650.514690:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946650.514700:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946650.514766:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522942464:0@lo:501: 00000100:00100000:2.0:1783946650.514793:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946650.514807:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0738e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783946650.514820:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522942464 00000100:00100000:2.0:1783946650.514823:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522942464 00000100:00100000:2.0:1783946650.514854:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783946650.514860:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522942464:12345-0@lo:501: 00000100:00100000:2.0:1783946650.514996:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522942464:12345-0@lo:501: Request processed in 135us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946650.515002:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783946650.515035:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522942464:0@lo:501: 00000100:00100000:2.0:1783946650.515091:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522942592:0@lo:503: 00000100:00100000:2.0:1783946650.515132:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946650.515145:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0738e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783946650.515157:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522942592 00000100:00100000:2.0:1783946650.515161:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522942592 00000100:00100000:2.0:1783946650.515182:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783946650.515188:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522942592:12345-0@lo:503: 00000100:00100000:2.0:1783946650.515270:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522942592:12345-0@lo:503: Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946650.515277:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783946650.515319:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522942592:0@lo:503: 00000100:00100000:0.0:1783946650.517812:0:7304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:7304:1870603522942720:0@lo:502: 00000100:00100000:0.0:1783946650.517885:0:7304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.517919:0:7304:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946650.517965:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522942720 00000100:00100000:1.0:1783946650.517971:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522942720 00000100:00100000:1.0:1783946650.518029:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783946650.518039:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:7304:x1870603522942720:12345-0@lo:502: 00000100:00100000:1.0:1783946650.518180:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:7304:x1870603522942720:12345-0@lo:502: Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946650.518188:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783946650.518373:0:7304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:7304:1870603522942720:0@lo:502: 00000100:00100000:0.0:1783946650.518419:0:7304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:7304:1870603522942848:0@lo:502: 00000100:00100000:0.0:1783946650.518452:0:7304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.518475:0:7304:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946650.519610:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522942848 00000100:00100000:1.0:1783946650.519620:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522942848 00000100:00100000:1.0:1783946650.519665:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783946650.519675:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:7304:x1870603522942848:12345-0@lo:502: 00000100:00100000:1.0:1783946650.525207:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:7304:x1870603522942848:12345-0@lo:502: Request processed in 5524us (6744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946650.525226:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783946650.525477:0:7304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:7304:1870603522942848:0@lo:502: 00000040:00080000:0.0:1783946650.525524:0:7304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1783946650.534262:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1783946650.534300:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783946650.534312:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946650.534333:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946650.534343:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783946650.534346:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff913786178000 from 4 10000000:01000000:1.0:1783946650.534348:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783946650.534392:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946650.534402:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946650.534415:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946650.534443:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522942976:0@lo:101: 00000100:00100000:1.0:1783946650.534518:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946650.534568:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783946650.537427:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522942976 00000100:00100000:0.0:1783946650.537439:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522942976 00000100:00100000:0.0:1783946650.537500:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783946650.537512:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522942976:12345-0@lo:101: 00010000:00010000:0.0:1783946650.537528:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946650.537548:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db70f6 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.537576:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db70f6 expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.537588:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db70f6 expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.537607:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030200, rc 0) 00000100:00100000:0.0:1783946650.537687:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522942976:12345-0@lo:101: Request processed in 177us (3168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946650.537694:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783946650.537752:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522942976:0@lo:101: 00010000:00010000:0.0:1783946650.537770:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.537781:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946650.537852:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522943104:0@lo:256: 00000100:00100000:0.0:1783946650.537900:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.537933:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:0.0:1783946650.537950:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522943104 00000100:00100000:0.0:1783946650.537956:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522943104 00000100:00100000:0.0:1783946650.537985:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783946650.537992:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522943104:12345-0@lo:256: 20000000:01000000:0.0:1783946650.538008:0:5951:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783946650.538025:0:5951:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783946650.538028:0:5951:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1783946650.538133:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522943104:12345-0@lo:256: Request processed in 141us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946650.538141:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783946650.538172:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522943104:0@lo:256: 10000000:01000000:0.0:1783946650.538210:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783946650.538216:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.538224:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946650.538232:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783946650.538234:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1783946650.538237:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783946650.538255:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.538262:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.538281:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946650.538292:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522943232:0@lo:101: 00000100:00100000:0.0:1783946650.538316:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.538330:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:0.0:1783946650.538342:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522943232 00000100:00100000:0.0:1783946650.538346:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522943232 00000100:00100000:0.0:1783946650.538367:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783946650.538373:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522943232:12345-0@lo:101: 00010000:00010000:0.0:1783946650.538380:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946650.538388:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7104 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.538401:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7104 expref: 15 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.538409:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7104 expref: 15 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.538416:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030600, rc 0) 00000100:00100000:0.0:1783946650.538444:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522943232:12345-0@lo:101: Request processed in 71us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946650.538450:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783946650.538480:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522943232:0@lo:101: 00010000:00010000:0.0:1783946650.538491:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.538509:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946650.538560:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522943360:0@lo:501: 00000100:00100000:0.0:1783946650.538585:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.538613:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:0.0:1783946650.538625:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522943360 00000100:00100000:0.0:1783946650.538629:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522943360 00000100:00100000:0.0:1783946650.538649:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783946650.538655:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522943360:12345-0@lo:501: 00000100:00100000:0.0:1783946650.538770:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522943360:12345-0@lo:501: Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946650.538777:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783946650.538805:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522943360:0@lo:501: 00000100:00100000:0.0:1783946650.538831:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522943488:0@lo:503: 00000100:00100000:0.0:1783946650.538868:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.538884:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:0.0:1783946650.538896:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522943488 00000100:00100000:0.0:1783946650.538899:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522943488 00000100:00100000:0.0:1783946650.538919:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783946650.538924:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522943488:12345-0@lo:503: 00000100:00100000:0.0:1783946650.539002:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522943488:12345-0@lo:503: Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946650.539009:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783946650.539048:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522943488:0@lo:503: 00000100:00100000:0.0:1783946650.539254:0:7307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:7307:1870603522943616:0@lo:502: 00000100:00100000:0.0:1783946650.539288:0:7307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.539309:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522943616 00000100:00100000:0.0:1783946650.539312:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522943616 00000100:00100000:0.0:1783946650.539333:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783946650.539338:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:7307:x1870603522943616:12345-0@lo:502: 00000100:00100000:0.0:1783946650.539408:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:7307:x1870603522943616:12345-0@lo:502: Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946650.539414:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783946650.539441:0:7307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd240 going to sleep for 11 seconds 00000100:00100000:0.0:1783946650.539452:0:7307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:7307:1870603522943616:0@lo:502: 00000020:01000000:0.0:1783946650.539472:0:7307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783946650.539480:0:7307:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783946650.539486:0:7307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946650.539489:0:7307:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783946650.539493:0:7307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783946650.539497:0:7307:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:0.0:1783946650.539519:0:7307:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783946650.539522:0:7307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783946650.539535:0:7307:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9137b65e0000) 00000020:00000080:0.0:1783946650.539552:0:7307:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1783946650.539557:0:7307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783946650.539642:0:7307:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783946650.539648:0:7307:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783946650.539655:0:7307:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db7119 00010000:00080000:0.0:1783946650.539683:0:7307:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9137b65dc000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1783946650.539966:0:7307:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1783946650.560253:0:7307:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783946650.560285:0:7307:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783946650.560635:0:7307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783946650.560833:0:7307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783946650.560916:0:7307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1783946650.561024:0:7307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1783946650.562488:0:7311:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783946650.562495:0:7311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783946650.564482:0:7307:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783946650.564499:0:7307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783946650.564540:0:7307:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783946650.564563:0:7307:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db7120 00000100:00080000:0.0:1783946650.564574:0:7307:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783946650.564581:0:7307:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9137b65dc000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946650.564748:0:7307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137a3502300 x1870603522943744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783946650.564778:0:7307:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783946650.564837:0:7307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946650.564841:0:7307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946650.564843:0:7307:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783946650.564846:0:7307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946650.564851:0:7307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946650.564852:0:7307:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783946650.564855:0:7307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783946650.564856:0:7307:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783946650.564883:0:7307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:7307:1870603522944128:0@lo:502: 00000100:00100000:0.0:1783946650.564964:0:7307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946650.565175:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603522943744:0@lo:8: 00000100:00100000:2.0:1783946650.565181:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522944000:0@lo:400: 00000100:00100000:1.0:1783946650.565219:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946650.565243:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946650.565257:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522943872:0@lo:400: 00000100:00100000:0.0:1783946650.565648:0:7307:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379838f900 going to sleep for 11 seconds 00000100:00100000:0.0:1783946650.565677:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522944128 00000100:00100000:0.0:1783946650.565684:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522944128 00000100:00100000:0.0:1783946650.565724:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783946650.565733:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:7307:x1870603522944128:12345-0@lo:502: 00000100:00100000:1.0:1783946650.569921:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946650.570035:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522943744 00000100:00100000:1.0:1783946650.570043:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522943744 00000100:00100000:1.0:1783946650.570136:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783946650.570144:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3446:x1870603522943744:12345-0@lo:8: 00010000:00080000:1.0:1783946650.570175:0:6942:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1783946650.570213:0:6942:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db7127 00002000:00100000:1.0:1783946650.570251:0:6942:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9137a4a0d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783946650.570255:0:6942:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1783946650.570259:0:6942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1783946650.570332:0:6942:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783946650.570705:0:6942:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783946650.570735:0:6942:0:(import.c:65:import_set_state_nolock()) ffff9137a4a0d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783946650.570794:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3446:x1870603522943744:12345-0@lo:8: Request processed in 648us (5574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946650.570802:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783946650.570832:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522944000 00000100:00100000:1.0:1783946650.570836:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522944000 00000100:00100000:1.0:1783946650.570873:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522943872 00000100:00100000:1.0:1783946650.570876:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522943872 00000100:00100000:1.0:1783946650.570893:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783946650.570899:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522944000:12345-0@lo:400: 00000100:00100000:1.0:1783946650.570935:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522944000:12345-0@lo:400: Request processed in 35us (5694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946650.570942:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783946650.570953:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783946650.570958:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522943872:12345-0@lo:400: 00000100:00100000:1.0:1783946650.570987:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522943872:12345-0@lo:400: Request processed in 29us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946650.570993:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783946650.571214:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137a3502300 x1870603522943744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783946660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946650.571225:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783946650.571239:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783946650.571247:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783946650.571252:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783946650.571255:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b65dc000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783946650.571267:0:3446:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783946650.571272:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603522943744:0@lo:8: 00000100:00080000:1.0:1783946650.571306:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783946650.571329:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b9ce7b80 x1870603522943872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946650.571339:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522943872:0@lo:400: 00000004:00080000:1.0:1783946650.571481:0:7311:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783946650.571540:0:7311:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 254490479498ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783946650.571546:0:7311:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:2.0:1783946650.572868:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b9ce6300 x1870603522944000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946650.572886:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522944000:0@lo:400: 00000100:00100000:0.0:1783946650.576215:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:7307:x1870603522944128:12345-0@lo:502: Request processed in 10474us (11242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946650.576229:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783946650.576295:0:7307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:7307:1870603522944128:0@lo:502: 00000020:01000000:0.0:1783946650.576329:0:7307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946650.576335:0:7307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946650.576337:0:7307:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783946650.576341:0:7307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1783946650.576551:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1783946650.576573:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783946650.576583:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.576605:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946650.576615:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783946650.576618:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9137909d0000 from 1 10000000:01000000:0.0:1783946650.576621:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783946650.576703:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.576711:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.576720:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946650.576742:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522944256:0@lo:101: 00000100:00100000:0.0:1783946650.576780:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.576815:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913785635600 going to sleep for 11 seconds 00000100:00100000:3.0:1783946650.576826:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522944256 00000100:00100000:3.0:1783946650.576832:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522944256 00000100:00100000:3.0:1783946650.576920:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783946650.576931:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522944256:12345-0@lo:101: 00010000:00010000:3.0:1783946650.576944:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946650.576958:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db712e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946650.576995:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db712e expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946650.577007:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db712e expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946650.577015:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151ae00, rc 0) 00000100:00100000:3.0:1783946650.577054:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522944256:12345-0@lo:101: Request processed in 125us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946650.577088:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:1.0:1783946650.579848:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783946650.580710:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522944256:0@lo:101: 00010000:00010000:0.0:1783946650.580745:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.580760:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946650.580851:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522944384:0@lo:501: 00000100:00100000:0.0:1783946650.580914:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.580964:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913785635600 going to sleep for 11 seconds 00000100:00100000:1.0:1783946650.581175:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522944384 00000100:00100000:1.0:1783946650.581183:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522944384 00000100:00100000:1.0:1783946650.581233:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783946650.581242:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522944384:12345-0@lo:501: 00000100:00100000:0.0:1783946650.581421:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522944384:0@lo:501: 10000000:01000000:0.0:1783946650.581469:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783946650.581480:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946650.581489:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946650.581552:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522944384:12345-0@lo:501: Request processed in 105us (431us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783946650.581561:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1783946650.583766:0:7312:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783946650.583805:0:7312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3501180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7312:1870603522944640:0@lo:7: 00000100:00100000:0.0:1783946650.583880:0:7312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.583923:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522944640 00000100:00100000:1.0:1783946650.583927:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522944512:0@lo:13: 00000100:00100000:0.0:1783946650.583931:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522944640 00000100:00100000:0.0:1783946650.584007:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783946650.584018:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7312:x1870603522944640:12345-0@lo:7: 00000100:00100000:1.0:1783946650.584053:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783946650.584118:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946650.584139:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522944512 00000100:00100000:1.0:1783946650.584143:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522944512 00000100:00100000:1.0:1783946650.584174:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783946650.584187:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3447:x1870603522944512:12345-0@lo:13: 00002000:00000024:1.0:1783946650.584206:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1783946650.584250:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3447:x1870603522944512:12345-0@lo:13: Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946650.584258:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783946650.584297:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137a3502d80 x1870603522944512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946650.584314:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522944512:0@lo:13: 00000001:02000400:2.0:1783946650.585443:0:7313:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783946650.588125:0:7312:0:(client.c:2702:ptlrpc_set_wait()) set ffff913785635600 going to sleep for 11 seconds 00002000:00080000:0.0:1783946650.589389:0:6945:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1783946650.589396:0:6945:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783946650.590403:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7312:x1870603522944640:12345-0@lo:7: Request processed in 6379us (6514us total) trans 0 rc 0/0 00010000:00080000:1.0:1783946650.590413:0:7312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137a3501180 x1870603522944640/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783946666 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946650.590417:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783946650.590430:0:7312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3501180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7312:1870603522944640:0@lo:7: 00000004:00080000:1.0:1783946650.590448:0:7312:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1783946650.590504:0:7312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7312:1870603522944768:0@lo:5: 00000100:00100000:1.0:1783946650.590552:0:7312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946650.590591:0:7312:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f840 going to sleep for 11 seconds 00000100:00100000:3.0:1783946650.590646:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522944768 00000100:00100000:3.0:1783946650.590654:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522944768 00000100:00100000:3.0:1783946650.590709:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783946650.590720:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7312:x1870603522944768:12345-0@lo:5: 00002000:00080000:3.0:1783946650.590745:0:6944:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1783946650.590749:0:6944:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1783946650.608123:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1783946650.608144:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783946650.608369:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7312:x1870603522944768:12345-0@lo:5: Request processed in 17644us (17810us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783946650.608383:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783946650.608552:0:7312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b653e300 x1870603522944768/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783946666 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946650.608564:0:7312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783946650.608571:0:7312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7312:1870603522944768:0@lo:5: 00000004:00080000:1.0:1783946650.608586:0:7312:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783946650.608658:0:7312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7312:1870603522944896:0@lo:700: 00000100:00100000:2.0:1783946650.613761:0:7312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946650.613822:0:7312:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f840 going to sleep for 11 seconds 00000100:00100000:0.0:1783946650.613894:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522944896 00000100:00100000:0.0:1783946650.613903:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522944896 00000100:00100000:0.0:1783946650.613958:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946650.613969:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7312:x1870603522944896:12345-0@lo:700: 00000100:00100000:0.0:1783946650.614027:0:6951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3501180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6951:1870603522945024:0@lo:700: 00000100:00100000:0.0:1783946650.614089:0:6951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.614111:0:6951:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:2.0:1783946650.614665:0:5963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522945024 00000100:00100000:2.0:1783946650.614670:0:5963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522945024 00000100:00100000:2.0:1783946650.614712:0:5963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946650.614721:0:5963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6951:x1870603522945024:12345-0@lo:700: 40000000:02000000:2.0:1783946650.623138:0:5963:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1783946650.634404:0:5963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6951:x1870603522945024:12345-0@lo:700: Request processed in 19674us (20304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946650.634431:0:5963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783946650.634725:0:6951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137a3501180 x1870603522945024/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783946666 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946650.634745:0:6951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3501180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6951:1870603522945024:0@lo:700: 40000000:02000000:2.0:1783946650.634760:0:6951:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1783946650.665040:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7312:x1870603522944896:12345-0@lo:700: Request processed in 51063us (51276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946650.665087:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783946650.665200:0:7312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b653e300 x1870603522944896/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783946666 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946650.665217:0:7312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7312:1870603522944896:0@lo:700: 00000004:02000040:0.0:1783946650.676817:0:7312:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1783946650.680194:0:7312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7312:1870603522945152:0@lo:5: 00000100:00100000:0.0:1783946650.680265:0:7312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946650.680332:0:7312:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd000 going to sleep for 11 seconds 00000100:00100000:2.0:1783946650.681083:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522945152 00000100:00100000:2.0:1783946650.681093:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522945152 00000100:00100000:2.0:1783946650.681164:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946650.681175:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7312:x1870603522945152:12345-0@lo:5: 00002000:00080000:2.0:1783946650.686431:0:6945:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1783946650.686452:0:6945:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1783946650.701833:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7312:x1870603522945152:12345-0@lo:5: Request processed in 20651us (21560us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783946650.701848:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783946650.705961:0:7312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137a3502300 x1870603522945152/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783946666 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946650.705984:0:7312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7312:1870603522945152:0@lo:5: 00000004:00080000:2.0:1783946650.706002:0:7312:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1783946650.772708:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783946651.669481:0:7365:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946651.670785:0:7365:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783946651.792348:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783946652.625641:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1783946652.816683:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946653.848301:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783946654.750180:0:7466:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783946654.751710:0:7466:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783946654.865887:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946655.632985:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522945280:0@lo:13: 00000100:00100000:2.0:1783946655.633096:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946655.633188:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522945280 00000100:00100000:2.0:1783946655.633196:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522945280 00000100:00100000:2.0:1783946655.633245:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946655.633254:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522945280:12345-0@lo:13: 00002000:00000024:2.0:1783946655.633282:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946655.633322:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522945280:12345-0@lo:13: Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946655.633341:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783946655.633362:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783946655.633907:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522945408:0@lo:400: 00000100:00100000:0.0:1783946655.633957:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946655.633982:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946655.633989:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522945536:0@lo:400: 00000100:00100000:0.0:1783946655.634012:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946655.634038:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522945408 00000100:00100000:0.0:1783946655.634044:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522945408 00000100:00100000:0.0:1783946655.634094:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783946655.634102:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3449:x1870603522945408:12345-0@lo:400: 00000100:00100000:0.0:1783946655.634144:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3449:x1870603522945408:12345-0@lo:400: Request processed in 44us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946655.634152:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783946655.634194:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522945536 00000100:00100000:0.0:1783946655.634198:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522945536 00000100:00100000:0.0:1783946655.634227:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783946655.634234:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522945536:12345-0@lo:400: 00010000:00080000:2.0:1783946655.639562:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b65a8a80 x1870603522945280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946655.639581:0:3448:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783946655.639613:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522945280:0@lo:13: 00000100:00100000:2.0:1783946655.639641:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946655.639653:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522945664:0@lo:400: 00000100:00100000:2.0:1783946655.640567:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946655.640644:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522945664 00000100:00100000:2.0:1783946655.640653:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522945664 00000100:00100000:0.0:1783946655.641720:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522945536:12345-0@lo:400: Request processed in 7481us (7701us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946655.641733:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783946655.641815:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137a3503100 x1870603522945536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946655.641830:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522945536:0@lo:400: 00000100:00100000:0.0:1783946655.641842:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522945408:0@lo:400: 00000100:00100000:2.0:1783946655.641919:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783946655.641932:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522945664:12345-0@lo:400: 00000100:00100000:2.0:1783946655.642004:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522945664:12345-0@lo:400: Request processed in 77us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946655.642010:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1783946655.642029:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783946655.643227:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137a3500a80 x1870603522945664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946655.643243:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522945664:0@lo:400: 00000020:00000004:3.0:1783946655.817488:0:7514:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946655.817499:0:7514:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1783946655.890968:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946656.914513:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946657.939872:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946658.961784:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946659.987220:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946660.753745:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522945792:0@lo:400: 00000100:00100000:2.0:1783946660.753820:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946660.753872:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946660.753878:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522946176:0@lo:400: 00000100:00100000:2.0:1783946660.753903:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946660.753931:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522945920:0@lo:400: 00000100:00100000:2.0:1783946660.753958:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946660.753975:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946660.753979:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522946048:0@lo:400: 00000100:00100000:2.0:1783946660.753998:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946660.754029:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522946176 00000100:00100000:2.0:1783946660.754037:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522946176 00000100:00100000:2.0:1783946660.754113:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946660.754122:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522946176:12345-0@lo:400: 00000100:00100000:2.0:1783946660.754170:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522946176:12345-0@lo:400: Request processed in 49us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946660.754177:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946660.754199:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522945920 00000100:00100000:2.0:1783946660.754203:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522945920 00000100:00100000:2.0:1783946660.754225:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522946048 00000100:00100000:2.0:1783946660.754228:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522946048 00000100:00100000:2.0:1783946660.754245:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783946660.754251:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522945920:12345-0@lo:400: 00000100:00100000:2.0:1783946660.754281:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522945920:12345-0@lo:400: Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946660.754287:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783946660.754297:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783946660.754304:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522946048:12345-0@lo:400: 00000100:00100000:2.0:1783946660.754357:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522946048:12345-0@lo:400: Request processed in 54us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946660.754363:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783946660.754383:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783946660.754387:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783946660.754419:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b65a9880 x1870603522946048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946660.754444:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522946048:0@lo:400: 00010000:00080000:2.0:1783946660.754465:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b65a8000 x1870603522945920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946660.754476:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522945920:0@lo:400: 00010000:00080000:2.0:1783946660.754504:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b65a8e00 x1870603522946176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946660.754514:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522946176:0@lo:400: 00000100:00100000:1.0:1783946660.754639:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522945792 00000100:00100000:1.0:1783946660.754644:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522945792 00000100:00100000:1.0:1783946660.754675:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783946660.754682:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3448:x1870603522945792:12345-0@lo:400: 00000100:00100000:1.0:1783946660.754718:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3448:x1870603522945792:12345-0@lo:400: Request processed in 37us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946660.754725:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783946660.755733:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522945792:0@lo:400: 00000100:00100000:2.0:1783946660.755907:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522946304:0@lo:13: 00000100:00100000:2.0:1783946660.755949:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946660.756291:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522946304 00000100:00100000:0.0:1783946660.756298:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522946304 00000100:00100000:0.0:1783946660.756529:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946660.756539:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522946304:12345-0@lo:13: 00002000:00000024:0.0:1783946660.756564:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946660.756730:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522946304:12345-0@lo:13: Request processed in 192us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946660.756737:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783946660.756797:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b9ce6d80 x1870603522946304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946660.756817:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522946304:0@lo:13: 00010000:00010000:2.0:1783946661.008272:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946662.032280:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946663.058515:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946664.081242:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946665.109261:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946665.872249:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522946432:0@lo:13: 00000100:00100000:2.0:1783946665.872320:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946665.872401:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522946432 00000100:00100000:2.0:1783946665.872408:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522946432 00000100:00100000:2.0:1783946665.872465:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946665.872480:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522946432:12345-0@lo:13: 00002000:00000024:2.0:1783946665.872510:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946665.872555:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522946432:12345-0@lo:13: Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946665.872562:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1783946665.872581:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783946665.872608:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b65a8e00 x1870603522946432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946665.872626:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522946432:0@lo:13: 00000100:00100000:0.0:1783946665.872810:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522946688:0@lo:400: 00000100:00100000:0.0:1783946665.872854:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946665.872873:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783946665.872879:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522946816:0@lo:400: 00000100:00100000:0.0:1783946665.872899:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946665.873186:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522946688 00000100:00100000:2.0:1783946665.873191:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522946688 00000100:00100000:2.0:1783946665.873217:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522946816 00000100:00100000:2.0:1783946665.873220:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522946816 00000100:00100000:2.0:1783946665.873245:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783946665.873252:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522946688:12345-0@lo:400: 00000100:00100000:2.0:1783946665.873292:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522946688:12345-0@lo:400: Request processed in 40us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946665.873299:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783946665.873311:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783946665.873317:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522946816:12345-0@lo:400: 00000100:00100000:2.0:1783946665.873358:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522946816:12345-0@lo:400: Request processed in 42us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946665.873364:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783946665.873389:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522946560:0@lo:400: 00000100:00100000:2.0:1783946665.873421:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946665.873459:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522946560 00000100:00100000:2.0:1783946665.873468:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522946560 00000100:00100000:2.0:1783946665.873492:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783946665.873498:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3450:x1870603522946560:12345-0@lo:400: 00000100:00100000:2.0:1783946665.873528:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3450:x1870603522946560:12345-0@lo:400: Request processed in 30us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946665.873534:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1783946665.873555:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946665.873571:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522946560:0@lo:400: 00010000:00080000:2.0:1783946665.873597:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137a3503100 x1870603522946816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946665.873608:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522946816:0@lo:400: 00010000:00080000:2.0:1783946665.873617:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137a3500000 x1870603522946688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946665.873627:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522946688:0@lo:400: 00010000:00010000:1.0:1783946666.131973:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783946666.204367:0:8013:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783946666.204370:0:8013:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783946666.204372:0:8013:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783946666.204466:0:8013:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9137a7c0f800 00000020:01000004:2.0:1783946666.204479:0:8013:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783946666.204489:0:8013:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783946666.204501:0:8013:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9137a07319c0) 00000020:00000080:2.0:1783946666.204518:0:8013:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783946666.247834:0:8013:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1783946666.247888:0:8013:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1783946666.282722:0:8013:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783946666.282949:0:8013:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1783946666.282962:0:8013:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783946666.282977:0:8013:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x229d2ec450db7143 00000020:01000004:0.0:1783946666.282984:0:8013:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1783946666.283006:0:8013:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783946666.283010:0:8013:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783946666.283017:0:8013:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1783946666.283047:0:8013:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1783946666.283053:0:8013:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783946666.293929:0:8013:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783946666.293974:0:8013:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.118@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1783946666.293978:0:8013:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783946666.293984:0:8013:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783946666.293985:0:8013:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783946666.293986:0:8013:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783946666.293987:0:8013:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783946666.293988:0:8013:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783946666.293989:0:8013:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783946666.293991:0:8013:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783946666.293992:0:8013:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783946666.293994:0:8013:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783946666.293995:0:8013:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783946666.293998:0:8013:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1783946666.294000:0:8013:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783946666.294002:0:8013:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783946666.294003:0:8013:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783946666.294004:0:8013:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783946666.294004:0:8013:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783946666.294005:0:8013:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783946666.294006:0:8013:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783946666.294007:0:8013:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783946666.294008:0:8013:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783946666.294009:0:8013:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783946666.294010:0:8013:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783946666.294038:0:8013:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783946666.294083:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3501f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522946944:0@lo:253: 00000100:00100000:0.0:1783946666.294157:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946666.294203:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522946944 00000100:00100000:0.0:1783946666.294209:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783946666.294212:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522946944 00000100:00100000:1.0:1783946666.294266:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783946666.294282:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:8013:x1870603522946944:12345-0@lo:253: 20000000:01000000:1.0:1783946666.294459:0:5950:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783946666.294462:0:5950:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1783946666.294466:0:5950:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1783946666.294469:0:5950:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1783946666.294611:0:5950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783946666.294818:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1783946666.294828:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1783946666.294840:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1783946666.294843:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1783946666.294850:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1783946666.294865:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1783946666.294924:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1783946666.294933:0:5950:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:1.0:1783946666.294934:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:1.0:1783946666.294942:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1783946666.294946:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783946666.294953:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1783946666.294956:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:0.0:1783946666.295269:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1783946666.295280:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783946666.295297:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1783946666.295316:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1783946666.295695:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1783946666.295709:0:5950:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:0.0:1783946666.295710:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:0.0:1783946666.295725:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1783946666.295732:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783946666.295746:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1783946666.295750:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:0.0:1783946666.295774:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1783946666.295780:0:5950:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783946666.295808:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1783946666.295825:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1783946666.295839:0:5950:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783946666.295843:0:5950:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783946666.295847:0:5950:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783946666.295888:0:5950:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783946666.295891:0:5950:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783946666.296617:0:8019:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1783946666.296638:0:8019:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1783946666.296653:0:8019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1783946666.296851:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1783946666.296869:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1783946666.296880:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1783946666.296887:0:5950:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783946666.296889:0:5950:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783946666.301610:0:8020:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1783946666.301691:0:8020:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1783946666.301705:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1783946666.301972:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1783946666.301999:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1783946666.302014:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1783946666.302026:0:5950:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783946666.302029:0:5950:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783946666.302622:0:8021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1783946666.302813:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1783946666.302834:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1783946666.302849:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1783946666.302859:0:5950:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783946666.302861:0:5950:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783946666.305211:0:8022:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1783946666.305260:0:8022:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1783946666.305270:0:8022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1783946666.306940:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1783946666.306985:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1783946666.307002:0:5950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1783946666.307017:0:5950:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783946666.307040:0:5950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.307092:0:5950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7094 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.307121:0:5950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db70be expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.307129:0:5950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db70e8 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.307136:0:5950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7104 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.307143:0:5950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db712e expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.307152:0:5950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.307200:0:5950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db712e expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.307214:0:5950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db712e expref: 16 pid: 5950 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.307229:0:5950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3501880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947072:0@lo:104: 00000100:00100000:0.0:1783946666.307297:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946666.307842:0:5940:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783946666.307870:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522947072 00000100:00100000:1.0:1783946666.307878:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522947072 00000100:00100000:1.0:1783946666.307931:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783946666.307940:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5950:x1870603522947072:12345-0@lo:104: 00010000:00010000:1.0:1783946666.307953:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.308020:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783946666.308025:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4aa7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5950:x1870603522947072:12345-0@lo:104: Request processed in 87us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946666.308032:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783946666.308287:0:5950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7104 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.308297:0:5950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7104 expref: 16 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.308308:0:5950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3501c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947200:0@lo:104: 00000100:00100000:0.0:1783946666.308505:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783946666.308533:0:5950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db70e8 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.308542:0:5950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db70e8 expref: 16 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.308551:0:5950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947328:0@lo:104: 00000100:00100000:0.0:1783946666.308570:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783946666.308635:0:5950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db70be expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.308644:0:5950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db70be expref: 16 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.308652:0:5950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947456:0@lo:104: 00000100:00100000:0.0:1783946666.308674:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783946666.308820:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946666.308828:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946666.308836:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946666.308840:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946666.308850:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946666.308868:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946666.308874:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783946666.308910:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946666.308917:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783946666.308935:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946666.308944:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913780030e00/0x229d2ec450db712e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7135 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946666.308957:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946666.308958:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946666.308974:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946666.314850:0:5950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7094 expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.314871:0:5950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7094 expref: 16 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.314887:0:5950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947712:0@lo:104: 00000100:00100000:0.0:1783946666.314945:0:5950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.316324:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522947200 00000100:00100000:2.0:1783946666.316344:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522947200 00000100:00100000:0.0:1783946666.316449:0:5950:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946666.316476:0:5950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3501880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947072:0@lo:104: 00000100:00100000:2.0:1783946666.316582:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522947328 00000100:00100000:2.0:1783946666.316587:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522947328 00000100:00100000:2.0:1783946666.316598:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522947456 00000100:00100000:2.0:1783946666.316600:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522947456 00000100:00100000:2.0:1783946666.316624:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522947712 00000100:00100000:2.0:1783946666.316627:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522947712 00000100:00100000:2.0:1783946666.316702:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783946666.316712:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+6:5950:x1870603522947200:12345-0@lo:104: 00010000:00010000:2.0:1783946666.316726:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.316806:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783946666.316812:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+6:5950:x1870603522947200:12345-0@lo:104: Request processed in 102us (8307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.316819:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783946666.316835:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783946666.316840:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:5950:x1870603522947328:12345-0@lo:104: 00010000:00010000:2.0:1783946666.316847:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.316890:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783946666.316895:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:5950:x1870603522947328:12345-0@lo:104: Request processed in 56us (8324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.316901:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783946666.316912:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783946666.316917:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:5950:x1870603522947456:12345-0@lo:104: 00010000:00010000:2.0:1783946666.316924:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.316946:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783946666.316950:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:5950:x1870603522947456:12345-0@lo:104: Request processed in 33us (8276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.317308:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783946666.317323:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783946666.317340:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5950:x1870603522947712:12345-0@lo:104: 00010000:00010000:2.0:1783946666.317348:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317387:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783946666.317392:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5950:x1870603522947712:12345-0@lo:104: Request processed in 54us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.317398:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783946666.317422:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522947584:0@lo:103: 00000100:00100000:2.0:1783946666.317452:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783946666.317499:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783946666.317505:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317512:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946666.317517:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317524:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946666.317532:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946666.317539:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946666.317567:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317579:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946666.317596:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317603:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913780031200/0x229d2ec450db7104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db710b expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317616:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783946666.317619:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317625:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946666.317628:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317635:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946666.317653:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946666.317659:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946666.317672:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317678:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946666.317694:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317701:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db70e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70ef expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317715:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783946666.317718:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317723:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946666.317726:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317732:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946666.317738:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946666.317742:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946666.317753:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317758:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946666.317763:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317769:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db70be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70c5 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317776:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946666.317779:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317794:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137c21d4a00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946666.317797:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317803:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946666.317808:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946666.317813:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946666.317823:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317828:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946666.317833:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317840:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137c21d4a00/0x229d2ec450db7094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db709b expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.317852:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946666.317854:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946666.317855:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946666.317865:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522947968:0@lo:103: 00000100:00100000:2.0:1783946666.317889:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.317908:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946666.317913:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522948096:0@lo:103: 00000100:00100000:2.0:1783946666.317939:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946666.318174:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522947584 00000100:00100000:1.0:1783946666.318179:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522947584 00010000:00010000:1.0:1783946666.318197:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db712e expref: 17 pid: 5950 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946666.318208:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522947968 00000100:00100000:1.0:1783946666.318210:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522947968 00010000:00010000:1.0:1783946666.318216:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db70e8 expref: 18 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946666.318221:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522948096 00000100:00100000:1.0:1783946666.318227:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522948096 00010000:00010000:1.0:1783946666.318233:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db70be expref: 19 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946666.318241:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783946666.318245:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522947584:12345-0@lo:103: 00010000:00010000:1.0:1783946666.318253:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946666.318256:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db712e expref: 19 pid: 5950 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.318263:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db712e expref: 19 pid: 5950 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.318274:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91378151ae00/0x229d2ec450db7135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db712e expref: 19 pid: 5950 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.318288:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946666.318314:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:3449:x1870603522947584:12345-0@lo:103: Request processed in 68us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946666.318321:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783946666.318346:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783946666.318362:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:3447:x1870603522947968:12345-0@lo:103: 00010000:00010000:1.0:1783946666.318370:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946666.318374:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db70e8 expref: 17 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.318383:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db70e8 expref: 17 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.318392:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946666.318487:0:5950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3501c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947200:0@lo:104: 00010000:00010000:0.0:1783946666.318495:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622200/0x229d2ec450db70ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db70e8 expref: 17 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.318507:0:5950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947328:0@lo:104: 00000100:00100000:0.0:1783946666.318513:0:5950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3502300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947456:0@lo:104: 00000100:00100000:0.0:1783946666.318518:0:5950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5950:1870603522947712:0@lo:104: 00010000:00010000:0.0:1783946666.318541:0:5950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946666.321755:0:5941:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783946666.321773:0:5941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1783946666.321793:0:5942:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783946666.321807:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783946666.321817:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3447:x1870603522948096:12345-0@lo:103: 00010000:00010000:2.0:1783946666.321834:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946666.321841:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db70be expref: 16 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.321853:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db70be expref: 16 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.321870:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91378151ac00/0x229d2ec450db70c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db70be expref: 16 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.321884:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946666.321934:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:3447:x1870603522948096:12345-0@lo:103: Request processed in 120us (3995us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.321939:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783946666.322143:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3447:x1870603522947968:12345-0@lo:103: Request processed in 2992us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946666.322151:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783946666.324113:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522947840:0@lo:103: 00000100:00100000:2.0:1783946666.324183:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.324231:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783946666.324235:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522948224:0@lo:103: 00000100:00100000:2.0:1783946666.324250:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.324317:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522947584:0@lo:103: 00000100:00100000:2.0:1783946666.324370:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522948096:0@lo:103: 00000100:00100000:2.0:1783946666.324380:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522947968:0@lo:103: 00010000:00010000:2.0:1783946666.324416:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946666.324487:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522947840 00000100:00100000:2.0:1783946666.324492:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522947840 00010000:00010000:2.0:1783946666.324522:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7104 expref: 14 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946666.324546:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522948224 00000100:00100000:2.0:1783946666.324549:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522948224 00010000:00010000:2.0:1783946666.324559:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7094 expref: 15 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946666.324571:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783946666.324579:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:3450:x1870603522947840:12345-0@lo:103: 00010000:00010000:2.0:1783946666.324591:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946666.324596:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7104 expref: 15 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324606:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7104 expref: 15 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324621:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913780030600/0x229d2ec450db710b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7104 expref: 15 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324636:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946666.324669:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:3450:x1870603522947840:12345-0@lo:103: Request processed in 91us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.324676:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783946666.324692:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783946666.324697:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3450:x1870603522948224:12345-0@lo:103: 00010000:00010000:2.0:1783946666.324704:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946666.324714:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7094 expref: 13 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324721:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7094 expref: 13 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324731:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137c21d4e00/0x229d2ec450db709b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7094 expref: 13 pid: 5951 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324744:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324753:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324769:0:5943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324776:0:5943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324781:0:5943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324788:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324793:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946666.324797:0:5943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324804:0:5943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324826:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324835:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946666.324858:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3450:x1870603522948224:12345-0@lo:103: Request processed in 160us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.324863:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783946666.324887:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522948224:0@lo:103: 00000100:00100000:2.0:1783946666.324893:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522947840:0@lo:103: 00010000:00010000:2.0:1783946666.324912:0:5950:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324919:0:5950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.324925:0:5950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35be600/0x229d2ec450db714a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783946666.324938:0:5950:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783946666.328593:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:8013:x1870603522946944:12345-0@lo:253: Request processed in 34304us (34427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.328609:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783946666.328713:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3501f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522946944:0@lo:253: 10000000:01000000:0.0:1783946666.328728:0:8013:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783946666.328732:0:8013:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783946666.328733:0:8013:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783946666.328734:0:8013:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783946666.328735:0:8013:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1783946666.328737:0:8013:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783946666.328738:0:8013:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783946666.328739:0:8013:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783946666.328741:0:8013:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783946666.328742:0:8013:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783946666.328744:0:8013:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783946666.328765:0:8013:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9137a7c0f800 from lustre-OST0001 10000000:01000000:0.0:1783946666.328794:0:8013:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783946666.328797:0:8013:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783946666.328805:0:8013:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9137909d0000 local copy 10000000:01000000:0.0:1783946666.328809:0:8013:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783946666.328840:0:8013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.328850:0:8013:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.328858:0:8013:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.328884:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948352:0@lo:101: 00000100:00100000:0.0:1783946666.328918:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.328954:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776540 going to sleep for 11 seconds 00000100:00100000:1.0:1783946666.329204:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522948352 00000100:00100000:1.0:1783946666.329211:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522948352 00000100:00100000:1.0:1783946666.329257:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783946666.329267:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+11:8013:x1870603522948352:12345-0@lo:101: 00010000:00010000:1.0:1783946666.329279:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946666.329291:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7151 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.329313:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7151 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.329323:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7151 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.329341:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44c00, rc 0) 00000100:00100000:1.0:1783946666.329381:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522948352:12345-0@lo:101: Request processed in 116us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946666.329387:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783946666.329446:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948352:0@lo:101: 00010000:00010000:0.0:1783946666.329459:0:8013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.329467:0:8013:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.329559:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948480:0@lo:501: 00000100:00100000:0.0:1783946666.329584:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.329608:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776540 going to sleep for 11 seconds 00000100:00100000:2.0:1783946666.329654:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522948480 00000100:00100000:2.0:1783946666.329659:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522948480 00000100:00100000:2.0:1783946666.329694:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783946666.329700:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522948480:12345-0@lo:501: 00000100:00100000:2.0:1783946666.329743:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522948480:12345-0@lo:501: Request processed in 45us (159us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783946666.329755:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783946666.329829:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948480:0@lo:501: 10000000:01000000:0.0:1783946666.329838:0:8013:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783946666.329851:0:8013:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783946666.329855:0:8013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.329860:0:8013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.329864:0:8013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.329881:0:8013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783946666.329903:0:8013:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9137a7c0f800 10000000:01000000:0.0:1783946666.329906:0:8013:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783946666.329910:0:8013:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783946666.329912:0:8013:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783946666.329915:0:8013:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783946666.329916:0:8013:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783946666.329927:0:8013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.329932:0:8013:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.329937:0:8013:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.329944:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948608:0@lo:101: 00000100:00100000:0.0:1783946666.329973:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.329982:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783946666.330109:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522948608 00000100:00100000:1.0:1783946666.330113:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522948608 00000100:00100000:1.0:1783946666.330130:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783946666.330134:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522948608:12345-0@lo:101: 00010000:00010000:1.0:1783946666.330139:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946666.330145:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db715f expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.330155:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db715f expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.330167:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db715f expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.330172:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45c00, rc 0) 00000100:00100000:1.0:1783946666.330192:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522948608:12345-0@lo:101: Request processed in 57us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946666.330196:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:2.0:1783946666.330240:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946666.330245:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.330250:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf200 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946666.330253:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.330259:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946666.330264:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946666.330268:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946666.330287:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.330292:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946666.330315:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.330322:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35bf200/0x229d2ec450db7151 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x229d2ec450db7158 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.330346:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946666.330348:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946666.330350:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946666.330360:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946666.330378:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522948736:0@lo:103: 00000100:00100000:2.0:1783946666.330403:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.330435:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522948736 00000100:00100000:2.0:1783946666.330439:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522948736 00000100:00100000:0.0:1783946666.330463:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948608:0@lo:101: 00000100:00100000:2.0:1783946666.330467:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946666.330474:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3449:x1870603522948736:12345-0@lo:103: 00010000:00010000:0.0:1783946666.330474:0:8013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.330482:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946666.330482:0:8013:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.330491:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7158 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db7151 expref: 13 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.330500:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946666.330524:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3449:x1870603522948736:12345-0@lo:103: Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.330530:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783946666.330541:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948864:0@lo:501: 00000100:00100000:2.0:1783946666.330554:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522948736:0@lo:103: 00000100:00100000:0.0:1783946666.330565:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.330580:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783946666.330585:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522948864 00000100:00100000:2.0:1783946666.330588:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522948864 00000100:00100000:2.0:1783946666.330620:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783946666.330626:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522948864:12345-0@lo:501: 00000100:00100000:2.0:1783946666.330736:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522948864:12345-0@lo:501: Request processed in 110us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.330742:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783946666.330878:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948864:0@lo:501: 00000100:00100000:0.0:1783946666.330925:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948992:0@lo:503: 00000100:00100000:0.0:1783946666.330958:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.331086:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783946666.331124:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522948992 00000100:00100000:1.0:1783946666.331127:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522948992 00000100:00100000:1.0:1783946666.331144:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783946666.331148:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522948992:12345-0@lo:503: 00000100:00100000:1.0:1783946666.331209:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522948992:12345-0@lo:503: Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946666.331219:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783946666.331239:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522948992:0@lo:503: 00000040:00080000:0.0:1783946666.331657:0:8013:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783946666.331729:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949120:0@lo:502: 00000100:00100000:0.0:1783946666.331762:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.331785:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783946666.331801:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522949120 00000100:00100000:2.0:1783946666.331805:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522949120 00000100:00100000:2.0:1783946666.331836:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783946666.331840:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522949120:12345-0@lo:502: 00000100:00100000:2.0:1783946666.331902:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522949120:12345-0@lo:502: Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.331916:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783946666.331925:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949120:0@lo:502: 00000040:00080000:0.0:1783946666.332132:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783946666.332158:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783946666.332173:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783946666.332187:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783946666.332200:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783946666.332213:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783946666.332231:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949248:0@lo:502: 00000100:00100000:0.0:1783946666.332265:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.332357:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522949248 00000100:00100000:2.0:1783946666.332361:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522949248 00000100:00100000:2.0:1783946666.332394:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783946666.332400:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522949248:12345-0@lo:502: 00000100:00100000:2.0:1783946666.332457:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522949248:12345-0@lo:502: Request processed in 56us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.332463:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783946666.332482:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946666.332495:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949248:0@lo:502: 00000040:00080000:0.0:1783946666.332528:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783946666.332535:0:8013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1783946666.334854:0:8024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783946666.334865:0:8024:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783946666.334871:0:8024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946666.334872:0:8024:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783946666.334877:0:8024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783946666.334889:0:8024:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9137b9cf99c0) 00000020:00000080:1.0:1783946666.334906:0:8024:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783946666.334909:0:8024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783946666.334984:0:8024:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9137a7c0f800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783946666.334990:0:8024:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783946666.334995:0:8024:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x229d2ec450db7174 00010000:00010000:1.0:1783946666.337621:0:8024:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1783946666.337868:0:8024:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1783946666.346990:0:8024:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783946666.347581:0:8024:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1783946666.351476:0:8024:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1783946666.351649:0:8024:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1783946666.355815:0:8024:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1783946666.356765:0:8024:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783946666.356779:0:8024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946666.356787:0:8024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946666.356789:0:8024:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783946666.356792:0:8024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783946666.356797:0:8024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946666.356798:0:8024:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783946666.356801:0:8024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783946666.356803:0:8024:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783946666.356826:0:8024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946666.356829:0:8024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946666.356831:0:8024:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783946666.356834:0:8024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783946666.357249:0:8013:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1783946666.357462:0:8013:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783946666.357485:0:8013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.357499:0:8013:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946666.357508:0:8013:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137a7c0f800 from 1 10000000:01000000:2.0:1783946666.357511:0:8013:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783946666.357549:0:8013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.357557:0:8013:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.357568:0:8013:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946666.357592:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949376:0@lo:101: 00000100:00100000:2.0:1783946666.357670:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946666.357710:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522949376 00000100:00100000:1.0:1783946666.357718:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522949376 00000100:00100000:1.0:1783946666.357778:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783946666.357789:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:8013:x1870603522949376:12345-0@lo:101: 00010000:00010000:1.0:1783946666.357802:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946666.357943:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db717b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.357969:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db717b expref: 13 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.357980:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db717b expref: 13 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.357990:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44c00, rc 0) 00000100:00100000:1.0:1783946666.358043:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522949376:12345-0@lo:101: Request processed in 255us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946666.358084:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783946666.359154:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946666.359184:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949376:0@lo:101: 00010000:00010000:2.0:1783946666.359204:0:8013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.359215:0:8013:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946666.359343:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949504:0@lo:501: 00000100:00100000:2.0:1783946666.359398:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.359526:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522949504 00000100:00100000:0.0:1783946666.359532:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522949504 00000100:00100000:0.0:1783946666.359583:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783946666.359596:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522949504:12345-0@lo:501: 00000100:00100000:0.0:1783946666.359701:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522949504:12345-0@lo:501: Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946666.359708:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783946666.359961:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946666.359976:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949504:0@lo:501: 00000100:00100000:2.0:1783946666.360004:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949632:0@lo:503: 00000100:00100000:2.0:1783946666.360040:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.360099:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946666.360161:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522949632 00000100:00100000:0.0:1783946666.360165:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522949632 00000100:00100000:0.0:1783946666.360195:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783946666.360202:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522949632:12345-0@lo:503: 00000100:00100000:0.0:1783946666.360537:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522949632:12345-0@lo:503: Request processed in 334us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946666.360545:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783946666.360627:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949632:0@lo:503: 00000040:00080000:2.0:1783946666.360878:0:8013:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783946666.360954:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949760:0@lo:502: 00000100:00100000:2.0:1783946666.360995:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.361020:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946666.361092:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522949760 00000100:00100000:3.0:1783946666.361098:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522949760 00000100:00100000:3.0:1783946666.361130:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783946666.361140:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522949760:12345-0@lo:502: 00000100:00100000:3.0:1783946666.361230:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522949760:12345-0@lo:502: Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946666.361237:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783946666.361482:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949760:0@lo:502: 00000040:00080000:0.0:1783946666.361663:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783946666.361691:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783946666.361714:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949888:0@lo:502: 00000100:00100000:0.0:1783946666.361751:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.361825:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522949888 00000100:00100000:2.0:1783946666.361830:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522949888 00000100:00100000:2.0:1783946666.361860:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783946666.361867:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522949888:12345-0@lo:502: 00000100:00100000:2.0:1783946666.361933:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522949888:12345-0@lo:502: Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.361946:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783946666.362481:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a06670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946666.362498:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522949888:0@lo:502: 00000040:00080000:0.0:1783946666.362545:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783946666.362552:0:8013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783946666.365842:0:8028:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783946666.365856:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946666.365858:0:8028:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783946666.365867:0:8028:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9137a7c0f800 00000020:00000080:2.0:1783946666.365870:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783946666.365882:0:8028:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783946666.365885:0:8028:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946666.365887:0:8028:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783946666.365890:0:8028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783946666.366283:0:8013:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783946666.366462:0:8013:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783946666.366514:0:8013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.366527:0:8013:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946666.366594:0:8013:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783946666.366597:0:8013:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9137a7c0f800 10000000:01000000:0.0:1783946666.366600:0:8013:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9137a7c0f800 10000000:01000000:0.0:1783946666.366604:0:8013:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783946666.366609:0:8013:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9137a7c0f800 from 1 10000000:01000000:0.0:1783946666.366612:0:8013:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783946666.366660:0:8013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.366669:0:8013:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.366681:0:8013:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.366708:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950016:0@lo:101: 00000100:00100000:0.0:1783946666.366780:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.366851:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f540 going to sleep for 11 seconds 00000100:00100000:2.0:1783946666.369172:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522950016 00000100:00100000:2.0:1783946666.369186:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522950016 00000100:00100000:2.0:1783946666.369363:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783946666.369375:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8013:x1870603522950016:12345-0@lo:101: 00010000:00010000:2.0:1783946666.369394:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946666.369412:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7189 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.369441:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7189 expref: 14 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.369452:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7189 expref: 14 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.369461:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622000, rc 0) 00000100:00100000:2.0:1783946666.369553:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522950016:12345-0@lo:101: Request processed in 182us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.369561:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783946666.369662:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950016:0@lo:101: 00010000:00010000:0.0:1783946666.369681:0:8013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.369691:0:8013:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.369790:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950144:0@lo:501: 00000100:00100000:0.0:1783946666.369821:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.370259:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783946666.370311:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522950144 00000100:00100000:3.0:1783946666.370317:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522950144 00000100:00100000:3.0:1783946666.370350:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783946666.370357:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522950144:12345-0@lo:501: 00000100:00100000:3.0:1783946666.370464:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522950144:12345-0@lo:501: Request processed in 107us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946666.370472:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783946666.370570:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950144:0@lo:501: 00000100:00100000:0.0:1783946666.370597:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950272:0@lo:503: 00000100:00100000:0.0:1783946666.370940:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.371291:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783946666.371352:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522950272 00000100:00100000:3.0:1783946666.371356:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522950272 00000100:00100000:2.0:1783946666.371447:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783946666.371462:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522950272:12345-0@lo:503: 00000100:00100000:2.0:1783946666.371552:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522950272:12345-0@lo:503: Request processed in 91us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.371559:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783946666.371720:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950272:0@lo:503: 00000040:00080000:3.0:1783946666.372084:0:8013:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783946666.372150:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950400:0@lo:502: 00000100:00100000:3.0:1783946666.372189:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946666.372208:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787c049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946666.372302:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522950400 00000100:00100000:0.0:1783946666.372307:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522950400 00000100:00100000:0.0:1783946666.372355:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783946666.372363:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522950400:12345-0@lo:502: 00000100:00100000:0.0:1783946666.372440:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522950400:12345-0@lo:502: Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946666.372447:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783946666.372740:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950400:0@lo:502: 00000040:00080000:3.0:1783946666.372946:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783946666.373046:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783946666.373456:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783946666.373476:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783946666.373489:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783946666.373503:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783946666.373515:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783946666.373526:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783946666.373538:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783946666.373550:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783946666.373563:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783946666.373574:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783946666.373585:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783946666.373599:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783946666.373611:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783946666.373625:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783946666.373759:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783946666.373779:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783946666.373792:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783946666.373821:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783946666.373843:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783946666.373856:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783946666.373868:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783946666.373884:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783946666.373897:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783946666.373909:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783946666.373920:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783946666.373931:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1783946666.373942:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783946666.373951:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1783946666.374193:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1783946666.374210:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1783946666.374221:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1783946666.374232:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1783946666.374243:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1783946666.374266:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1783946666.374280:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1783946666.374316:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950528:0@lo:502: 00000100:00100000:0.0:1783946666.374384:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.374467:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783946666.374509:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522950528 00000100:00100000:2.0:1783946666.374516:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522950528 00000100:00100000:2.0:1783946666.376193:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783946666.376217:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522950528:12345-0@lo:502: 00000100:00100000:2.0:1783946666.376424:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522950528:12345-0@lo:502: Request processed in 218us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.376432:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783946666.376656:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522950528:0@lo:502: 00000040:00080000:1.0:1783946666.376745:0:8013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1783946666.376758:0:8013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1783946666.378798:0:8029:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783946666.378819:0:8029:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9137b65e4d40) 00000020:00000080:0.0:1783946666.378844:0:8029:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1783946666.379247:0:8029:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9137a7c0f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783946666.379253:0:8029:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9137a7c0f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783946666.379255:0:8029:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9137a7c0f800 3 00010000:00080000:0.0:1783946666.379286:0:8029:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9137be1a8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1783946666.382476:0:8029:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1783946666.382603:0:8029:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783946666.382653:0:8029:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783946666.382666:0:8029:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x229d2ec450db719e 00000100:00080000:0.0:1783946666.382683:0:8029:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783946666.382691:0:8029:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9137be1a8000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946666.382730:0:8029:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137bdee4700 x1870603522950656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783946666.382762:0:8029:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783946666.383052:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522950784:0@lo:400: 00000100:00100000:0.0:1783946666.383155:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.383313:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783946666.383321:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522950912:0@lo:400: 00000100:00100000:0.0:1783946666.383358:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.383403:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522950784 00000100:00100000:0.0:1783946666.383411:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522950784 00000100:00100000:0.0:1783946666.383447:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522950912 00000100:00100000:0.0:1783946666.383450:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522950912 00000100:00100000:0.0:1783946666.383470:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783946666.383478:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522950784:12345-0@lo:400: 00000100:00100000:0.0:1783946666.383530:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522950784:12345-0@lo:400: Request processed in 51us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946666.383537:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783946666.383551:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783946666.383557:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522950912:12345-0@lo:400: 00000100:00100000:0.0:1783946666.383584:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522950912:12345-0@lo:400: Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946666.383590:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783946666.383632:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b9ce4700 x1870603522950912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946666.383645:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522950912:0@lo:400: 00010000:00080000:0.0:1783946666.383665:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b9ce5180 x1870603522950784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946666.383674:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522950784:0@lo:400: 00000100:00100000:0.0:1783946666.383797:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522951040:0@lo:400: 00000100:00100000:0.0:1783946666.383827:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.383944:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522951040 00000100:00100000:0.0:1783946666.383949:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522951040 00000100:00100000:1.0:1783946666.384108:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3446:1870603522950656:0@lo:38: 00000100:00100000:1.0:1783946666.384143:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.384186:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783946666.384194:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522951040:12345-0@lo:400: 00000100:00100000:0.0:1783946666.384230:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522951040:12345-0@lo:400: Request processed in 37us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946666.384236:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783946666.384296:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b9ce5880 x1870603522951040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946666.384307:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522951040:0@lo:400: 00000100:00100000:0.0:1783946666.384321:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522950656 00000100:00100000:0.0:1783946666.384334:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522950656 00000100:00100000:0.0:1783946666.384352:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783946666.384357:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3446:x1870603522950656:12345-0@lo:38: 00010000:00080000:0.0:1783946666.384377:0:5957:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:0.0:1783946666.384408:0:5957:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x229d2ec450db71a5 00000004:00100000:0.0:1783946666.384422:0:5957:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783946666.384449:0:5957:0:(import.c:65:import_set_state_nolock()) ffff9137be1a8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783946666.384483:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1870603522950656:12345-0@lo:38: Request processed in 125us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946666.384499:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783946666.384538:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137bdee4700 x1870603522950656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783946676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946666.384546:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783946666.384552:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1783946666.384558:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783946666.384562:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783946666.384564:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137be1a8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783946666.384569:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3446:1870603522950656:0@lo:38: 00000040:00080000:0.0:1783946666.384698:0:8029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1783946666.384857:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8031:1870603522951168:0@lo:901: 00000100:00100000:3.0:1783946666.384887:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946666.384937:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787c04600 going to sleep for 11 seconds 00000100:00100000:0.0:1783946666.385144:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522951168 00000100:00100000:0.0:1783946666.385149:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522951168 00000100:00100000:0.0:1783946666.385223:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946666.385230:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8031:x1870603522951168:12345-0@lo:901: 00000100:00100000:0.0:1783946666.385302:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8031:x1870603522951168:12345-0@lo:901: Request processed in 72us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946666.385308:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783946666.385351:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783946666.385376:0:8031:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137b9ce5f80 x1870603522951168/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783946682 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946666.385386:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8031:1870603522951168:0@lo:901: 00000020:01000000:1.0:1783946666.385654:0:8013:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1783946666.385688:0:8013:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783946666.385708:0:8013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.385720:0:8013:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783946666.385767:0:8013:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783946666.385769:0:8013:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783946666.385771:0:8013:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783946666.385772:0:8013:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783946666.385773:0:8013:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783946666.385775:0:8013:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783946666.385776:0:8013:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783946666.385777:0:8013:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783946666.385779:0:8013:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783946666.385781:0:8013:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783946666.385783:0:8013:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783946666.385787:0:8013:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783946666.385789:0:8013:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783946666.385790:0:8013:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783946666.385791:0:8013:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783946666.385791:0:8013:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783946666.385792:0:8013:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783946666.385793:0:8013:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783946666.385796:0:8013:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783946666.385797:0:8013:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783946666.385797:0:8013:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783946666.385798:0:8013:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783946666.385799:0:8013:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783946666.385813:0:8013:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783946666.385821:0:8013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522951296:0@lo:253: 00000100:00100000:1.0:1783946666.385850:0:8013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946666.386199:0:8013:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a07389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946666.388180:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522951296 00000100:00100000:3.0:1783946666.388193:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522951296 00000100:00100000:3.0:1783946666.388245:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783946666.388255:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522951296:12345-0@lo:253: 20000000:01000000:3.0:1783946666.388286:0:5950:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783946666.388301:0:5950:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783946666.394098:0:5950:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783946666.394114:0:5950:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783946666.394221:0:5972:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783946666.394226:0:5972:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783946666.394245:0:5972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.394260:0:5972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db70f6 expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.394266:0:5972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.394305:0:5972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db70f6 expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.394315:0:5972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db70f6 expref: 14 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.394345:0:5972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5972:1870603522951424:0@lo:104: 00000100:00100000:0.0:1783946666.394415:0:5972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946666.394498:0:5972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f46d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783946666.394611:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8013:x1870603522951296:12345-0@lo:253: Request processed in 6355us (8756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.394621:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783946666.394642:0:8013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b032bb55-8d94-4093-96f3-a2f6fadccf82:8013:1870603522951296:0@lo:253: 10000000:01000000:3.0:1783946666.394653:0:8013:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783946666.394657:0:8013:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783946666.394659:0:8013:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783946666.394660:0:8013:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946666.394661:0:8013:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783946666.394663:0:8013:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946666.394664:0:8013:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946666.394666:0:8013:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783946666.394668:0:8013:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783946666.394669:0:8013:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783946666.394670:0:8013:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946666.394672:0:8013:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783946666.394688:0:8013:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783946666.394691:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522951424 00000100:00100000:1.0:1783946666.394697:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522951424 00000100:00100000:1.0:1783946666.394777:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783946666.394786:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5972:x1870603522951424:12345-0@lo:104: 00010000:00010000:1.0:1783946666.394798:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946666.394893:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783946666.394899:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:5972:x1870603522951424:12345-0@lo:104: Request processed in 115us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946666.394906:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1783946666.394945:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946666.394951:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.394965:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946666.394969:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.394978:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946666.394984:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946666.394998:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946666.395036:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395043:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946666.395079:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395087:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137b9f44000/0x229d2ec450db70f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70fd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395108:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946666.395110:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946666.395112:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946666.395133:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946666.395144:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522951552:0@lo:103: 00000100:00100000:2.0:1783946666.395181:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946666.395220:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522951552 00000100:00100000:2.0:1783946666.395224:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522951552 00010000:00010000:2.0:1783946666.395247:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db70f6 expref: 14 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946666.395277:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783946666.395285:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3534850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:3449:x1870603522951552:12345-0@lo:103: 00010000:00010000:2.0:1783946666.395295:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946666.395300:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db70f6 expref: 14 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395316:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db70f6 expref: 14 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395355:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395363:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783946666.395376:0:8023:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001903564s 00010000:00010000:2.0:1783946666.395379:0:8023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395393:0:8023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395400:0:8023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395407:0:8023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395418:0:8023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946666.395422:0:8023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395430:0:8023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395444:0:8023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946666.395454:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946666.395491:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3534850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:3449:x1870603522951552:12345-0@lo:103: Request processed in 206us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946666.395505:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783946666.395559:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522951552:0@lo:103: 00010000:00010000:0.0:1783946666.395633:0:5972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913780030200/0x229d2ec450db70fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db70f6 expref: 13 pid: 5949 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946666.395644:0:5972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5972:1870603522951424:0@lo:104: 00010000:00010000:0.0:1783946666.395656:0:5972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.395665:0:5972:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.395671:0:5972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946666.395677:0:5972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bf200/0x229d2ec450db71ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1783946666.403773:0:8013:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1783946666.403943:0:8013:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783946666.404148:0:8013:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783946666.404290:0:8013:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783946666.404512:0:8013:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1783946666.404667:0:8013:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1783946666.405577:0:8013:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1783946666.412902:0:8013:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783946666.412909:0:8013:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783946666.412939:0:8013:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783946666.413226:0:8013:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783946666.413250:0:8013:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783946666.413276:0:8013:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1783946666.413946:0:8013:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783946666.414193:0:8013:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783946667.158378:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783946667.484174:0:8083:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783946667.484437:0:8083:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783946668.188179:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946669.202211:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946670.226230:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946670.998588:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783946670.998612:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522951680:0@lo:13: 00000100:00100000:1.0:1783946670.998675:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946670.998748:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522951680 00000100:00100000:1.0:1783946670.998755:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522951680 00000100:00100000:1.0:1783946670.998807:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783946670.998815:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522951680:12345-0@lo:13: 00002000:00000024:1.0:1783946670.998843:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946670.998885:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522951680:12345-0@lo:13: Request processed in 70us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946670.998893:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1783946670.998910:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783946670.998938:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653d880 x1870603522951680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946670.998955:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522951680:0@lo:13: 00010000:00010000:1.0:1783946671.248210:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946671.514592:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522951808:0@lo:400: 00000100:00100000:3.0:1783946671.514669:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946671.514733:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522952320:0@lo:400: 00000100:00100000:3.0:1783946671.514760:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946671.516622:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783946671.516657:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522952192:0@lo:400: 00000100:00100000:2.0:1783946671.516866:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522951808 00000100:00100000:2.0:1783946671.516877:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522951808 00000100:00100000:2.0:1783946671.516942:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783946671.516953:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3448:x1870603522951808:12345-0@lo:400: 00000100:00100000:2.0:1783946671.517037:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3448:x1870603522951808:12345-0@lo:400: Request processed in 85us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946671.517044:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783946671.517616:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946671.517679:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522951808:0@lo:400: 00000100:00100000:3.0:1783946671.517729:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522951936:0@lo:400: 00000100:00100000:3.0:1783946671.517772:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946671.517796:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946671.517805:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522952064:0@lo:400: 00000100:00100000:3.0:1783946671.517831:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946671.517868:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522952320 00000100:00100000:3.0:1783946671.517874:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522952320 00000100:00100000:3.0:1783946671.517914:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522951936 00000100:00100000:3.0:1783946671.517917:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522951936 00000100:00100000:3.0:1783946671.517929:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522952064 00000100:00100000:3.0:1783946671.517932:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522952064 00000100:00100000:3.0:1783946671.517945:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783946671.517953:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522952320:12345-0@lo:400: 00000100:00100000:3.0:1783946671.517994:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522952320:12345-0@lo:400: Request processed in 42us (3233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946671.518002:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783946671.518016:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783946671.518022:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522951936:12345-0@lo:400: 00000100:00100000:3.0:1783946671.518055:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522951936:12345-0@lo:400: Request processed in 33us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946671.518083:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783946671.518096:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783946671.518102:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522952064:12345-0@lo:400: 00000100:00100000:3.0:1783946671.518127:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522952064:12345-0@lo:400: Request processed in 26us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946671.518133:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1783946671.518157:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783946671.518197:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b9ce4700 x1870603522952320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946671.518221:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522952320:0@lo:400: 00010000:00080000:3.0:1783946671.518255:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b9ce5880 x1870603522952064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946671.518265:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522952064:0@lo:400: 00010000:00080000:3.0:1783946671.518275:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b9ce5c00 x1870603522951936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946671.518731:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522952192 00000100:00100000:0.0:1783946671.518737:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522952192 00000100:00100000:0.0:1783946671.518771:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946671.518779:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522952192:12345-0@lo:400: 00000100:00100000:0.0:1783946671.518835:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522952192:12345-0@lo:400: Request processed in 58us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946671.518842:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783946671.518922:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522951936:0@lo:400: 00010000:00080000:3.0:1783946671.518962:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b9ce5180 x1870603522952192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946671.518973:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522952192:0@lo:400: 10000000:01000000:1.0:1783946672.018032:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783946672.018039:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9137b63de800 from 30 10000000:01000000:1.0:1783946672.018045:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783946672.018106:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.018118:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.018129:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946672.018153:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522952448:0@lo:101: 00000100:00100000:1.0:1783946672.018221:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.018289:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783946672.020319:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522952448 00000100:00100000:2.0:1783946672.020330:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522952448 00000100:00100000:2.0:1783946672.020380:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783946672.020388:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522952448:12345-0@lo:101: 00010000:00010000:2.0:1783946672.020403:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946672.020419:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db71b3 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946672.020445:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db71b3 expref: 14 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946672.020456:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db71b3 expref: 14 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946672.020465:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622800, rc 0) 00000100:00100000:2.0:1783946672.020591:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522952448:12345-0@lo:101: Request processed in 203us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946672.020599:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783946672.030333:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522952448:0@lo:101: 00010000:00010000:1.0:1783946672.030384:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.030398:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946672.030493:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522952576:0@lo:501: 00000100:00100000:1.0:1783946672.030563:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.030623:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.030652:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522952576 00000100:00100000:1.0:1783946672.030658:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522952576 00000100:00100000:1.0:1783946672.030702:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783946672.030710:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522952576:12345-0@lo:501: 00000100:00100000:1.0:1783946672.030848:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522952576:12345-0@lo:501: Request processed in 138us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.030857:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783946672.030893:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522952576:0@lo:501: 00000100:00100000:1.0:1783946672.030933:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522952704:0@lo:503: 00000100:00100000:1.0:1783946672.030972:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.030985:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.031306:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522952704 00000100:00100000:0.0:1783946672.031312:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522952704 00000100:00100000:0.0:1783946672.031346:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783946672.031354:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522952704:12345-0@lo:503: 00000100:00100000:0.0:1783946672.031438:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522952704:12345-0@lo:503: Request processed in 84us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.031445:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783946672.031504:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522952704:0@lo:503: 00000100:00100000:0.0:1783946672.031740:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8312:1870603522952832:0@lo:502: 00000100:00100000:0.0:1783946672.031773:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.031792:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde77c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.036365:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522952832 00000100:00100000:1.0:1783946672.036384:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522952832 00000100:00100000:1.0:1783946672.036470:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783946672.036484:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8312:x1870603522952832:12345-0@lo:502: 00000100:00100000:1.0:1783946672.036690:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8312:x1870603522952832:12345-0@lo:502: Request processed in 208us (4914us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.036698:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783946672.036840:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8312:1870603522952832:0@lo:502: 00000100:00100000:0.0:1783946672.036925:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8312:1870603522952960:0@lo:502: 00000100:00100000:0.0:1783946672.036968:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.037006:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde77c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.037185:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522952960 00000100:00100000:1.0:1783946672.037190:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522952960 00000100:00100000:1.0:1783946672.037224:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783946672.037238:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8312:x1870603522952960:12345-0@lo:502: 00000100:00100000:1.0:1783946672.037306:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8312:x1870603522952960:12345-0@lo:502: Request processed in 76us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.037313:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783946672.037383:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8312:1870603522952960:0@lo:502: 00000040:00080000:0.0:1783946672.037402:0:8312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783946672.037578:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783946672.037598:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783946672.037609:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.037621:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946672.037630:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783946672.037633:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1783946672.037636:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783946672.037660:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.037668:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.037677:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946672.037690:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953088:0@lo:101: 00000100:00100000:1.0:1783946672.037717:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.037746:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028240 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.037797:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522953088 00000100:00100000:0.0:1783946672.037802:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522953088 00000100:00100000:0.0:1783946672.037833:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783946672.037840:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522953088:12345-0@lo:101: 00010000:00010000:0.0:1783946672.037849:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946672.037867:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db71c1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.037890:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db71c1 expref: 15 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.037911:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db71c1 expref: 15 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.037921:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bfe00, rc 0) 00000100:00100000:0.0:1783946672.037953:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522953088:12345-0@lo:101: Request processed in 113us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.037959:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783946672.037988:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953088:0@lo:101: 00010000:00010000:0.0:1783946672.038000:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.038009:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946672.038053:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953216:0@lo:501: 00000100:00100000:0.0:1783946672.038097:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.038110:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde77480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.038120:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522953216 00000100:00100000:0.0:1783946672.038123:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522953216 00000100:00100000:0.0:1783946672.038143:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783946672.038149:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522953216:12345-0@lo:501: 00000100:00100000:0.0:1783946672.038254:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522953216:12345-0@lo:501: Request processed in 105us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.038269:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783946672.038296:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953216:0@lo:501: 00000100:00100000:0.0:1783946672.038319:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953344:0@lo:503: 00000100:00100000:0.0:1783946672.038350:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.038362:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde77480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.038373:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522953344 00000100:00100000:0.0:1783946672.038376:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522953344 00000100:00100000:0.0:1783946672.038394:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783946672.038400:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522953344:12345-0@lo:503: 00000100:00100000:0.0:1783946672.038467:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522953344:12345-0@lo:503: Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.038473:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783946672.038507:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953344:0@lo:503: 00000100:00100000:0.0:1783946672.038663:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8313:1870603522953472:0@lo:502: 00000100:00100000:0.0:1783946672.038695:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.038713:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522953472 00000100:00100000:0.0:1783946672.038716:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522953472 00000100:00100000:0.0:1783946672.038735:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783946672.038740:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:8313:x1870603522953472:12345-0@lo:502: 00000100:00100000:0.0:1783946672.038803:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:8313:x1870603522953472:12345-0@lo:502: Request processed in 62us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.038810:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783946672.038834:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.038844:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8313:1870603522953472:0@lo:502: 00000020:01000000:0.0:1783946672.038862:0:8313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946672.038873:0:8313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946672.038876:0:8313:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783946672.038881:0:8313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783946672.038883:0:8313:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783946672.038897:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8313:1870603522953600:0@lo:502: 00000100:00100000:0.0:1783946672.038924:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.038941:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522953600 00000100:00100000:0.0:1783946672.038945:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522953600 00000100:00100000:0.0:1783946672.038964:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783946672.038970:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:8313:x1870603522953600:12345-0@lo:502: 00000100:00100000:0.0:1783946672.039020:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:8313:x1870603522953600:12345-0@lo:502: Request processed in 50us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.039027:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783946672.039051:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.039083:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8313:1870603522953600:0@lo:502: 00000020:01000000:0.0:1783946672.039099:0:8313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946672.039103:0:8313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946672.039105:0:8313:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783946672.039108:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1783946672.039147:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1783946672.039162:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783946672.039169:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.039178:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946672.039186:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783946672.039189:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff913786178000 from 30 10000000:01000000:0.0:1783946672.039192:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783946672.039213:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.039221:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.039240:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946672.039251:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953728:0@lo:101: 00000100:00100000:0.0:1783946672.039274:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.039287:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.039297:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522953728 00000100:00100000:0.0:1783946672.039300:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522953728 00000100:00100000:0.0:1783946672.039319:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783946672.039324:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522953728:12345-0@lo:101: 00010000:00010000:0.0:1783946672.039331:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946672.039340:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db71cf expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.039355:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db71cf expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.039364:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db71cf expref: 16 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.039371:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf600, rc 0) 00000100:00100000:0.0:1783946672.039396:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522953728:12345-0@lo:101: Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.039402:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783946672.039436:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953728:0@lo:101: 00010000:00010000:0.0:1783946672.039447:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.039456:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946672.039490:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953856:0@lo:501: 00000100:00100000:0.0:1783946672.039512:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.039522:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.039532:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522953856 00000100:00100000:0.0:1783946672.039535:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522953856 00000100:00100000:0.0:1783946672.039553:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783946672.039559:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522953856:12345-0@lo:501: 00000100:00100000:0.0:1783946672.039632:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522953856:12345-0@lo:501: Request processed in 73us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.039638:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783946672.039664:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953856:0@lo:501: 00000100:00100000:0.0:1783946672.039685:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953984:0@lo:503: 00000100:00100000:0.0:1783946672.039716:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.039728:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.039739:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522953984 00000100:00100000:0.0:1783946672.039742:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522953984 00000100:00100000:0.0:1783946672.039760:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783946672.039766:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522953984:12345-0@lo:503: 00000100:00100000:0.0:1783946672.039823:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522953984:12345-0@lo:503: Request processed in 56us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.039837:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783946672.040226:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522953984:0@lo:503: 00000100:00100000:0.0:1783946672.050668:0:8314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8314:1870603522954112:0@lo:502: 00000100:00100000:0.0:1783946672.050768:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.050822:0:8314:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0738d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.050891:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522954112 00000100:00100000:1.0:1783946672.050899:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522954112 00000100:00100000:1.0:1783946672.050958:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783946672.050968:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:8314:x1870603522954112:12345-0@lo:502: 00000100:00100000:1.0:1783946672.051120:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:8314:x1870603522954112:12345-0@lo:502: Request processed in 153us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.051128:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783946672.051309:0:8314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8314:1870603522954112:0@lo:502: 00000100:00100000:3.0:1783946672.051360:0:8314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8314:1870603522954240:0@lo:502: 00000100:00100000:3.0:1783946672.051393:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946672.051411:0:8314:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc9fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.051468:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522954240 00000100:00100000:0.0:1783946672.051472:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522954240 00000100:00100000:0.0:1783946672.051505:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783946672.051512:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:8314:x1870603522954240:12345-0@lo:502: 00000100:00100000:0.0:1783946672.051585:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:8314:x1870603522954240:12345-0@lo:502: Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.051593:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783946672.051660:0:8314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8314:1870603522954240:0@lo:502: 00000040:00080000:3.0:1783946672.051680:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783946672.051867:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783946672.051887:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783946672.051896:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.051918:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946672.051928:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783946672.051930:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff913786178000 from 5 10000000:01000000:0.0:1783946672.051933:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783946672.051959:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.051967:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.051983:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946672.051995:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954368:0@lo:101: 00000100:00100000:0.0:1783946672.052020:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.052048:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0738300 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.052182:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522954368 00000100:00100000:1.0:1783946672.052186:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522954368 00000100:00100000:1.0:1783946672.052212:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783946672.052219:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522954368:12345-0@lo:101: 00010000:00010000:1.0:1783946672.052237:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946672.052250:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f45200/0x229d2ec450db71e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db71dd expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.052271:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f45200/0x229d2ec450db71e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db71dd expref: 17 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.052281:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f45200/0x229d2ec450db71e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db71dd expref: 17 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.052290:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45200, rc 0) 00000100:00100000:1.0:1783946672.052325:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522954368:12345-0@lo:101: Request processed in 107us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.052332:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783946672.054084:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954368:0@lo:101: 00010000:00010000:0.0:1783946672.054114:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946672.054126:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946672.054201:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954496:0@lo:256: 00000100:00100000:0.0:1783946672.054267:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.054306:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0738300 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.054377:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522954496 00000100:00100000:1.0:1783946672.054386:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522954496 00000100:00100000:1.0:1783946672.054439:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783946672.054450:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522954496:12345-0@lo:256: 20000000:01000000:1.0:1783946672.054474:0:5951:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783946672.054492:0:5951:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783946672.054495:0:5951:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1783946672.054581:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522954496:12345-0@lo:256: Request processed in 133us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.054589:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783946672.054675:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954496:0@lo:256: 10000000:01000000:3.0:1783946672.054722:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783946672.054729:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946672.054738:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946672.054752:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783946672.054754:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1783946672.054757:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783946672.054781:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946672.054788:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946672.054797:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946672.054810:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954624:0@lo:101: 00000100:00100000:3.0:1783946672.054835:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946672.054860:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc9fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.054910:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522954624 00000100:00100000:1.0:1783946672.054915:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522954624 00000100:00100000:1.0:1783946672.054945:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783946672.054952:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522954624:12345-0@lo:101: 00010000:00010000:1.0:1783946672.054961:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946672.054973:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db71eb expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.054990:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db71eb expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.055000:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db71eb expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.055008:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44600, rc 0) 00000100:00100000:1.0:1783946672.055038:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522954624:12345-0@lo:101: Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.055044:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783946672.055092:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954624:0@lo:101: 00010000:00010000:1.0:1783946672.055103:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.055112:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946672.055180:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954752:0@lo:501: 00000100:00100000:1.0:1783946672.055203:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.055216:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd77a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.055238:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522954752 00000100:00100000:1.0:1783946672.055242:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522954752 00000100:00100000:1.0:1783946672.055258:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783946672.055264:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522954752:12345-0@lo:501: 00000100:00100000:1.0:1783946672.055369:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522954752:12345-0@lo:501: Request processed in 104us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.055376:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783946672.055402:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954752:0@lo:501: 00000100:00100000:1.0:1783946672.055426:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954880:0@lo:503: 00000100:00100000:1.0:1783946672.055462:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.055478:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd77a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.055488:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522954880 00000100:00100000:1.0:1783946672.055491:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522954880 00000100:00100000:1.0:1783946672.055507:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783946672.055513:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522954880:12345-0@lo:503: 00000100:00100000:1.0:1783946672.055588:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522954880:12345-0@lo:503: Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.055595:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783946672.055631:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522954880:0@lo:503: 00000100:00100000:1.0:1783946672.057332:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8315:1870603522955008:0@lo:502: 00000100:00100000:1.0:1783946672.057420:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.057461:0:8315:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd77480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.057516:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522955008 00000100:00100000:0.0:1783946672.057525:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522955008 00000100:00100000:0.0:1783946672.057575:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783946672.057584:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8315:x1870603522955008:12345-0@lo:502: 00000100:00100000:0.0:1783946672.057698:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8315:x1870603522955008:12345-0@lo:502: Request processed in 114us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946672.057707:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783946672.057816:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8315:1870603522955008:0@lo:502: 00000020:01000000:1.0:1783946672.057849:0:8315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783946672.057857:0:8315:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783946672.057864:0:8315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946672.057866:0:8315:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783946672.057870:0:8315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783946672.057873:0:8315:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:1.0:1783946672.057897:0:8315:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783946672.057979:0:8315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783946672.057995:0:8315:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9137b9cf8000) 00000020:00000080:1.0:1783946672.058014:0:8315:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1783946672.058020:0:8315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783946672.058168:0:8315:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783946672.058174:0:8315:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783946672.058181:0:8315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db7200 00010000:00080000:1.0:1783946672.058215:0:8315:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9137bdc19000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1783946672.058462:0:8315:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1783946672.058589:0:8315:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783946672.058601:0:8315:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783946672.058760:0:8315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783946672.062464:0:8315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783946672.062738:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783946672.062834:0:8315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1783946672.067780:0:8316:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783946672.067791:0:8316:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783946672.068811:0:8315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783946672.068825:0:8315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783946672.068866:0:8315:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783946672.068888:0:8315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db7207 00000100:00080000:2.0:1783946672.068898:0:8315:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783946672.068914:0:8315:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9137bdc19000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1783946672.068954:0:8315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137b65aad80 x1870603522955136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783946672.068982:0:8315:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783946672.069038:0:8315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783946672.069042:0:8315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946672.069045:0:8315:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783946672.069048:0:8315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783946672.069052:0:8315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946672.069053:0:8315:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783946672.069056:0:8315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783946672.069087:0:8315:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783946672.069116:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8315:1870603522955264:0@lo:502: 00000100:00100000:2.0:1783946672.069196:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946672.069251:0:8315:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be32fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.069438:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603522955136:0@lo:8: 00000100:00100000:1.0:1783946672.069478:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.069693:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522955264 00000100:00100000:1.0:1783946672.069700:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522955264 00000100:00100000:1.0:1783946672.069761:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783946672.069773:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8315:x1870603522955264:12345-0@lo:502: 00000100:00100000:1.0:1783946672.069935:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8315:x1870603522955264:12345-0@lo:502: Request processed in 163us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.069942:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783946672.070142:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522955136 00000100:00100000:2.0:1783946672.070147:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522955136 00000100:00100000:2.0:1783946672.070178:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783946672.070184:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3446:x1870603522955136:12345-0@lo:8: 00010000:00080000:2.0:1783946672.070207:0:6944:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:2.0:1783946672.070246:0:6944:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db720e 00002000:00100000:2.0:1783946672.070268:0:6944:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9137b9ff6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783946672.070272:0:6944:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1783946672.070277:0:6944:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1783946672.070344:0:6944:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783946672.070619:0:6944:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783946672.070644:0:6944:0:(import.c:65:import_set_state_nolock()) ffff9137b9ff7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783946672.070784:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3446:x1870603522955136:12345-0@lo:8: Request processed in 597us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946672.070793:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783946672.070832:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8315:1870603522955264:0@lo:502: 00000020:01000000:2.0:1783946672.070878:0:8315:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783946672.070884:0:8315:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946672.070887:0:8315:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783946672.070892:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1783946672.071289:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1783946672.071309:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783946672.071319:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.071330:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946672.071340:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783946672.071342:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9137909d0000 from 1 10000000:01000000:1.0:1783946672.071345:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783946672.071375:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.071383:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.071393:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946672.071414:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522955392:0@lo:101: 00000100:00100000:1.0:1783946672.071470:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.071509:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946672.071559:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522955392 00000100:00100000:2.0:1783946672.071564:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522955392 00000100:00100000:2.0:1783946672.071606:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783946672.071614:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522955392:12345-0@lo:101: 00010000:00010000:2.0:1783946672.071624:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946672.071638:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7215 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946672.071659:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7215 expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946672.071668:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7215 expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946672.071677:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623800, rc 0) 00000100:00100000:2.0:1783946672.071718:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522955392:12345-0@lo:101: Request processed in 103us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946672.071724:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783946672.071754:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522955392:0@lo:101: 00010000:00010000:2.0:1783946672.071767:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946672.071776:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946672.071823:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522955520:0@lo:501: 00000100:00100000:2.0:1783946672.071846:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946672.071859:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be32f300 going to sleep for 11 seconds 00000100:00100000:2.0:1783946672.071871:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522955520 00000100:00100000:2.0:1783946672.071874:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522955520 00000100:00100000:2.0:1783946672.071896:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783946672.072013:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522955520:12345-0@lo:501: 00000100:00100000:2.0:1783946672.072191:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522955520:12345-0@lo:501: Request processed in 288us (343us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783946672.072198:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:3.0:1783946672.078525:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b65aad80 x1870603522955136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783946682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946672.078542:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783946672.078553:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783946672.078564:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783946672.078572:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783946672.078575:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137bdc19000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783946672.078599:0:3446:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783946672.078606:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603522955136:0@lo:8: 00000100:00100000:1.0:1783946672.079721:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522955520:0@lo:501: 00000004:00080000:1.0:1783946672.079757:0:8316:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 10000000:01000000:1.0:1783946672.079850:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783946672.079860:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946672.079871:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783946672.087129:0:8316:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 276006064622ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783946672.087147:0:8316:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1783946672.089550:0:8317:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1783946672.089585:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8317:1870603522955776:0@lo:7: 00000100:00100000:1.0:1783946672.089654:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.089693:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946672.089802:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522955648:0@lo:13: 00000100:00100000:3.0:1783946672.089839:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.089882:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522955648 00000100:00100000:3.0:1783946672.089883:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522955776 00000100:00100000:1.0:1783946672.089890:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522955648 00000100:00100000:3.0:1783946672.089897:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522955776 00000100:00100000:1.0:1783946672.089951:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783946672.089960:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783946672.089964:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3449:x1870603522955648:12345-0@lo:13: 00002000:00000024:1.0:1783946672.089993:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1783946672.090039:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3449:x1870603522955648:12345-0@lo:13: Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946672.090046:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1783946672.090192:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783946672.090459:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8317:x1870603522955776:12345-0@lo:7: 00010000:00080000:1.0:1783946672.099301:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653c000 x1870603522955648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946672.099335:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522955648:0@lo:13: 00002000:00080000:3.0:1783946672.101446:0:6942:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783946672.101456:0:6942:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783946672.101548:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8317:x1870603522955776:12345-0@lo:7: Request processed in 11574us (11890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946672.101560:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783946672.101746:0:8317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653e680 x1870603522955776/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783946688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946672.101767:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8317:1870603522955776:0@lo:7: 00000004:00080000:1.0:1783946672.101779:0:8317:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1783946672.101809:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8317:1870603522955904:0@lo:5: 00000100:00100000:1.0:1783946672.101840:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.101871:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946672.101893:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522955904 00000100:00100000:2.0:1783946672.101910:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522955904 00000100:00100000:2.0:1783946672.101961:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783946672.101971:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8317:x1870603522955904:12345-0@lo:5: 00002000:00080000:2.0:1783946672.101995:0:6944:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783946672.101998:0:6944:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000004:00080000:1.0:1783946672.104895:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00080000:1.0:1783946672.114817:0:8015:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1783946672.114841:0:8015:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783946672.114955:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8317:x1870603522955904:12345-0@lo:5: Request processed in 12982us (13109us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783946672.114963:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783946672.115030:0:8317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653e680 x1870603522955904/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783946688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946672.115039:0:8317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783946672.115043:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8317:1870603522955904:0@lo:5: 00000004:00080000:1.0:1783946672.115053:0:8317:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1783946672.115107:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8317:1870603522956032:0@lo:700: 00000100:00100000:1.0:1783946672.115132:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.115158:0:6951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522956032 00000100:00100000:1.0:1783946672.115162:0:6951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522956032 00000100:00100000:1.0:1783946672.115206:0:6951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783946672.115215:0:6951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8317:x1870603522956032:12345-0@lo:700: 00000100:00100000:1.0:1783946672.115261:0:6951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6951:1870603522956160:0@lo:700: 00000100:00100000:1.0:1783946672.115288:0:6951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946672.115323:0:6951:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd77000 going to sleep for 11 seconds 00000100:00100000:1.0:1783946672.115342:0:5963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522956160 00000100:00100000:1.0:1783946672.115345:0:5963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522956160 00000100:00100000:1.0:1783946672.115377:0:5963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783946672.115382:0:5963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6951:x1870603522956160:12345-0@lo:700: 00000100:00100000:1.0:1783946672.115464:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd776c0 going to sleep for 11 seconds 40000000:02000000:3.0:1783946672.131791:0:5963:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1783946672.136813:0:5963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6951:x1870603522956160:12345-0@lo:700: Request processed in 21422us (21516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946672.136841:0:5963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783946672.137120:0:6951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653ea00 x1870603522956160/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783946688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946672.137138:0:6951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6951:1870603522956160:0@lo:700: 40000000:02000000:1.0:1783946672.137156:0:6951:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1783946672.166892:0:6951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8317:x1870603522956032:12345-0@lo:700: Request processed in 51666us (51746us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946672.166923:0:6951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783946672.168613:0:8317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653e680 x1870603522956032/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783946688 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946672.168634:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8317:1870603522956032:0@lo:700: 00000004:02000040:0.0:1783946672.183020:0:8317:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1783946672.201045:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8317:1870603522956288:0@lo:5: 00000100:00100000:0.0:1783946672.201145:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946672.201201:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522956288 00000100:00100000:0.0:1783946672.201209:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522956288 00000100:00100000:0.0:1783946672.202557:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783946672.202581:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8317:x1870603522956288:12345-0@lo:5: 00002000:00080000:0.0:1783946672.212523:0:6942:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1783946672.212546:0:6942:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1783946672.214120:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0738300 going to sleep for 11 seconds 00000100:00100000:0.0:1783946672.224217:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8317:x1870603522956288:12345-0@lo:5: Request processed in 21639us (23063us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783946672.224243:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783946672.226176:0:8317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdee5500 x1870603522956288/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783946688 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946672.226197:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8317:1870603522956288:0@lo:5: 00000004:00080000:0.0:1783946672.226212:0:8317:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1783946672.277034:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946673.297594:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783946673.561055:0:8379:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783946674.320244:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783946674.610141:0:8431:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783946674.613484:0:8431:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783946675.345383:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783946675.522974:0:8015:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1783946676.113694:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522956416:0@lo:13: 00000100:00100000:0.0:1783946676.113768:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946676.114501:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522956416 00000100:00100000:1.0:1783946676.114509:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522956416 00000100:00100000:1.0:1783946676.114580:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783946676.114590:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522956416:12345-0@lo:13: 00002000:00000024:1.0:1783946676.114619:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946676.114676:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522956416:12345-0@lo:13: Request processed in 87us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946676.114683:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783946676.114812:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653ea00 x1870603522956416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946676.114830:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522956416:0@lo:13: 00000100:00080000:2.0:1783946676.114992:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783946676.374054:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946677.136425:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522956544:0@lo:400: 00000100:00100000:1.0:1783946677.136450:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522956800:0@lo:400: 00000100:00100000:0.0:1783946677.136664:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522956928:0@lo:400: 00000100:00100000:2.0:1783946677.136718:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522956672:0@lo:400: 00000100:00100000:1.0:1783946677.139897:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946677.139987:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522957312:0@lo:13: 00000100:00100000:1.0:1783946677.140030:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946677.140434:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522956800 00000100:00100000:1.0:1783946677.140443:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522956800 00000100:00100000:1.0:1783946677.140510:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783946677.140522:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522956800:12345-0@lo:400: 00000100:00100000:1.0:1783946677.140580:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522956800:12345-0@lo:400: Request processed in 62us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946677.140587:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783946677.140609:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522957312 00000100:00100000:1.0:1783946677.140613:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522957312 00000100:00100000:1.0:1783946677.140641:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783946677.140647:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522957312:12345-0@lo:13: 00002000:00000024:1.0:1783946677.140669:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946677.140700:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522957312:12345-0@lo:13: Request processed in 53us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946677.140706:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1783946677.140720:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783946677.140725:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783946677.140759:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdee4a80 x1870603522957312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946677.140769:0:3449:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783946677.140791:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522957312:0@lo:13: 00010000:00080000:1.0:1783946677.140803:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653e300 x1870603522956800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946677.140812:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522956800:0@lo:400: 00000100:00100000:3.0:1783946677.141340:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946677.141376:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522957056:0@lo:400: 00000100:00100000:3.0:1783946677.141406:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946677.141434:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522957056 00000100:00100000:3.0:1783946677.141438:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522957056 00000100:00100000:3.0:1783946677.141468:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783946677.141475:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522957056:12345-0@lo:400: 00000100:00100000:3.0:1783946677.141626:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522957056:12345-0@lo:400: Request processed in 150us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946677.141633:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1783946677.141664:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653e680 x1870603522957056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946677.141675:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522957056:0@lo:400: 00000100:00100000:0.0:1783946677.142712:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946677.143088:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522956928 00000100:00100000:3.0:1783946677.143095:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522956928 00000100:00100000:3.0:1783946677.143184:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783946677.143194:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522956928:12345-0@lo:400: 00000100:00100000:3.0:1783946677.143246:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522956928:12345-0@lo:400: Request processed in 54us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946677.143254:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783946677.143730:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653ea00 x1870603522956928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946677.143744:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522956928:0@lo:400: 00000100:00100000:2.0:1783946677.143949:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946677.144022:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522957184:0@lo:400: 00000100:00100000:2.0:1783946677.144052:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946677.144152:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522957184 00000100:00100000:0.0:1783946677.144157:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522957184 00000100:00100000:2.0:1783946677.144375:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783946677.144386:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522957184:12345-0@lo:400: 00000100:00100000:1.0:1783946677.144425:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522956544 00000100:00100000:2.0:1783946677.144427:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522957184:12345-0@lo:400: Request processed in 45us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946677.144430:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522956544 00000100:00100000:2.0:1783946677.144434:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783946677.144460:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bde8c000 x1870603522957184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946677.144460:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783946677.144469:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522957184:0@lo:400: 00000100:00100000:1.0:1783946677.144474:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522956544:12345-0@lo:400: 00000100:00100000:1.0:1783946677.144523:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522956544:12345-0@lo:400: Request processed in 49us (3184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946677.144530:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1783946677.144540:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946677.144611:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522956544:0@lo:400: 00000100:00100000:3.0:1783946677.144652:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522956672 00000100:00100000:3.0:1783946677.144656:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522956672 00000100:00100000:3.0:1783946677.144691:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783946677.144698:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522956672:12345-0@lo:400: 00000100:00100000:3.0:1783946677.144745:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522956672:12345-0@lo:400: Request processed in 47us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946677.144751:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783946677.144874:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653c700 x1870603522956672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946677.144881:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522956672:0@lo:400: 00010000:00010000:2.0:1783946677.393404:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783946677.683886:0:8532:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783946677.686430:0:8532:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783946678.427338:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783946679.043592:0:8580:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946679.043604:0:8580:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1783946679.440428:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946679.729773:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946679.733188:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507204224 00000100:00100000:3.0:1783946679.733204:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507204224 00000100:00100000:3.0:1783946679.733254:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:3.0:1783946679.733263:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1870603507204224:12345-192.168.201.18@tcp:250: 00010000:00080000:3.0:1783946679.733290:0:5951:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 1345f16d-a45e-4353-9d75-4f3fd8acb991@192.168.201.18@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:3.0:1783946679.733319:0:5951:0:(genops.c:1406:class_connect()) connect: client 1345f16d-a45e-4353-9d75-4f3fd8acb991, cookie 0x229d2ec450db7223 00000100:00080000:3.0:1783946679.733478:0:5951:0:(import.c:65:import_set_state_nolock()) ffff9137a7eed800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783946679.733556:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+5:2360:x1870603507204224:12345-192.168.201.18@tcp:250: Request processed in 293us (3791us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946679.733564:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:2.0:1783946679.740531:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946679.741236:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507204352 00000100:00100000:0.0:1783946679.741257:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507204352 00000100:00100000:0.0:1783946679.741321:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:0.0:1783946679.741332:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+5:5438:x1870603507204352:12345-192.168.201.18@tcp:101: 00010000:00010000:0.0:1783946679.741357:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946679.741375:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571d48 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946679.741403:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d48 expref: 6 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946679.741414:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d48 expref: 6 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946679.741423:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf400, rc 0) 00000100:00100000:0.0:1783946679.741649:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+6:5438:x1870603507204352:12345-192.168.201.18@tcp:101: Request processed in 318us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946679.741657:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:2.0:1783946679.747724:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946679.747821:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507204480 00000100:00100000:1.0:1783946679.747832:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507204480 00000100:00100000:1.0:1783946679.747890:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:1.0:1783946679.747909:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+6:5438:x1870603507204480:12345-192.168.201.18@tcp:501: 00000100:00100000:1.0:1783946679.748032:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+6:5438:x1870603507204480:12345-192.168.201.18@tcp:501: Request processed in 124us (319us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783946679.748040:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:1.0:1783946679.767203:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946679.768885:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507204608 00000100:00100000:3.0:1783946679.768900:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507204608 00000100:00100000:3.0:1783946679.768979:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:3.0:1783946679.768990:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+6:5438:x1870603507204608:12345-192.168.201.18@tcp:101: 00010000:00010000:3.0:1783946679.769022:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946679.769041:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571d4f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946679.769125:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d4f expref: 7 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946679.769135:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d4f expref: 7 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946679.769144:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151bc00, rc 0) 00000100:00100000:3.0:1783946679.769212:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+7:5438:x1870603507204608:12345-192.168.201.18@tcp:101: Request processed in 223us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946679.769218:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:2.0:1783946679.782826:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946679.783495:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507204736 00000100:00100000:0.0:1783946679.783507:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507204736 00000100:00100000:0.0:1783946679.783574:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:0.0:1783946679.783585:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+7:5438:x1870603507204736:12345-192.168.201.18@tcp:501: 00000100:00100000:0.0:1783946679.783777:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:5438:x1870603507204736:12345-192.168.201.18@tcp:501: Request processed in 193us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946679.783784:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:2.0:1783946679.788439:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946679.788617:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507204864 00000100:00100000:3.0:1783946679.788626:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507204864 00000100:00100000:3.0:1783946679.788682:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:3.0:1783946679.788693:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:5438:x1870603507204864:12345-192.168.201.18@tcp:503: 00000100:00100000:3.0:1783946679.788829:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:5438:x1870603507204864:12345-192.168.201.18@tcp:503: Request processed in 137us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946679.788837:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:1.0:1783946679.795837:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946679.795941:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507204992 00000100:00100000:3.0:1783946679.795951:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507204992 00000100:00100000:3.0:1783946679.796011:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:3.0:1783946679.796021:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:5457:x1870603507204992:12345-192.168.201.18@tcp:502: 00000100:00100000:3.0:1783946679.796218:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:5457:x1870603507204992:12345-192.168.201.18@tcp:502: Request processed in 198us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946679.796236:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:2.0:1783946679.839826:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946679.839909:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507205120 00000100:00100000:0.0:1783946679.839926:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507205120 00000100:00100000:0.0:1783946679.839976:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:0.0:1783946679.839984:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:5457:x1870603507205120:12345-192.168.201.18@tcp:502: 00000100:00100000:0.0:1783946679.840182:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:5457:x1870603507205120:12345-192.168.201.18@tcp:502: Request processed in 197us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946679.840190:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:2.0:1783946679.843965:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946679.844134:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507205248 00000100:00100000:1.0:1783946679.844145:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507205248 00000100:00100000:1.0:1783946679.844194:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:1.0:1783946679.844205:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:5438:x1870603507205248:12345-192.168.201.18@tcp:101: 00010000:00010000:1.0:1783946679.844222:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946679.844240:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44400/0x229d2ec450db7238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571d79 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946679.844280:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44400/0x229d2ec450db7238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d79 expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946679.844291:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44400/0x229d2ec450db7238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d79 expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946679.844324:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44400, rc 0) 00000100:00100000:1.0:1783946679.844669:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5438:x1870603507205248:12345-192.168.201.18@tcp:101: Request processed in 465us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946679.844676:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:1.0:1783946679.851241:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946679.851740:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507205376 00000100:00100000:3.0:1783946679.851752:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507205376 00000100:00100000:3.0:1783946679.851812:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:3.0:1783946679.851822:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5438:x1870603507205376:12345-192.168.201.18@tcp:256: 20000000:01000000:3.0:1783946679.851854:0:5951:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783946679.851879:0:5951:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783946679.851883:0:5951:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783946679.851886:0:5951:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783946679.851888:0:5951:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1783946679.856592:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5438:x1870603507205376:12345-192.168.201.18@tcp:256: Request processed in 4639us (5230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946679.856608:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:2.0:1783946679.866709:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946679.866872:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507205504 00000100:00100000:0.0:1783946679.866882:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507205504 00000100:00100000:0.0:1783946679.866951:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:0.0:1783946679.866963:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5438:x1870603507205504:12345-192.168.201.18@tcp:101: 00010000:00010000:0.0:1783946679.866983:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946679.867002:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571d80 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946679.867031:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d80 expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946679.867042:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d80 expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946679.867051:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf800, rc 0) 00000100:00100000:0.0:1783946679.867164:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5438:x1870603507205504:12345-192.168.201.18@tcp:101: Request processed in 203us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946679.867188:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:1.0:1783946679.870690:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946679.870983:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507205632 00000100:00100000:3.0:1783946679.870993:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507205632 00000100:00100000:3.0:1783946679.871054:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:3.0:1783946679.871111:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5438:x1870603507205632:12345-192.168.201.18@tcp:501: 00000100:00100000:3.0:1783946679.871291:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5438:x1870603507205632:12345-192.168.201.18@tcp:501: Request processed in 182us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946679.871299:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:2.0:1783946679.879653:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946679.879751:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507205760 00000100:00100000:1.0:1783946679.879760:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507205760 00000100:00100000:1.0:1783946679.879811:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:1.0:1783946679.879820:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5438:x1870603507205760:12345-192.168.201.18@tcp:503: 00000100:00100000:1.0:1783946679.879977:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5438:x1870603507205760:12345-192.168.201.18@tcp:503: Request processed in 157us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946679.879985:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:2.0:1783946679.894971:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946679.897125:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507205888 00000100:00100000:0.0:1783946679.897141:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507205888 00000100:00100000:0.0:1783946679.897204:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:0.0:1783946679.897214:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5461:x1870603507205888:12345-192.168.201.18@tcp:502: 00000100:00100000:0.0:1783946679.897399:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5461:x1870603507205888:12345-192.168.201.18@tcp:502: Request processed in 186us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946679.897408:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:0.0:1783946679.908234:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946679.908473:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507206016 00000100:00100000:3.0:1783946679.908486:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507206016 00000100:00100000:3.0:1783946679.908560:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 128 00000100:00100000:3.0:1783946679.908573:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5461:x1870603507206016:12345-192.168.201.18@tcp:502: 00000100:00100000:3.0:1783946679.908807:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5461:x1870603507206016:12345-192.168.201.18@tcp:502: Request processed in 236us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946679.908826:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 128 00000100:00100000:2.0:1783946679.914279:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946679.914407:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507206144 00000100:00100000:0.0:1783946679.914420:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507206144 00000100:00100000:0.0:1783946679.914491:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:0.0:1783946679.914500:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1870603507206144:12345-192.168.201.18@tcp:38: 00010000:00080000:0.0:1783946679.914542:0:5957:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:0.0:1783946679.914616:0:5957:0:(genops.c:1406:class_connect()) connect: client c2268401-da9f-4e1e-8a1c-9473caf67cba, cookie 0x229d2ec450db7246 00000004:00100000:0.0:1783946679.914648:0:5957:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1783946679.914656:0:5957:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1783946679.926156:0:5957:0:(import.c:65:import_set_state_nolock()) ffff9137be1af000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783946679.926266:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2360:x1870603507206144:12345-192.168.201.18@tcp:38: Request processed in 11764us (12012us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946679.926281:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00010000:00010000:2.0:1783946680.472812:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946680.933852:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946680.933909:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946680.934218:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507206400 00000100:00100000:0.0:1783946680.934229:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507206400 00000100:00100000:0.0:1783946680.934403:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507206272 00000100:00100000:0.0:1783946680.934407:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507206272 00000100:00100000:0.0:1783946680.934431:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:0.0:1783946680.934456:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:5438:x1870603507206400:12345-192.168.201.18@tcp:41: 00000004:00000024:0.0:1783946680.934497:0:5956:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1783946680.934629:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:5438:x1870603507206400:12345-192.168.201.18@tcp:41: Request processed in 174us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946680.934637:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:0.0:1783946680.934656:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1783946680.934663:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:0:x1870603507206272:12345-192.168.201.18@tcp:41: 00000004:00000024:0.0:1783946680.934674:0:5956:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1783946680.934697:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:0:x1870603507206272:12345-192.168.201.18@tcp:41: Request processed in 35us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946680.934704:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00080000:2.0:1783946680.934826:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946680.943472:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946680.944056:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507206528 00000100:00100000:0.0:1783946680.944136:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507206528 00000100:00100000:0.0:1783946680.944220:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1783946680.944232:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:5438:x1870603507206528:12345-192.168.201.18@tcp:40: 00000100:00100000:0.0:1783946680.944568:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:5438:x1870603507206528:12345-192.168.201.18@tcp:40: Request processed in 337us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946680.944577:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1783946680.947418:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946680.947470:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946680.947572:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507207040 00000100:00100000:1.0:1783946680.947582:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507207040 00000100:00100000:1.0:1783946680.947638:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 129 00000100:00100000:1.0:1783946680.947648:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2364:x1870603507207040:12345-192.168.201.18@tcp:400: 00000100:00100000:1.0:1783946680.947724:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2364:x1870603507207040:12345-192.168.201.18@tcp:400: Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946680.947733:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 129 00000100:00100000:3.0:1783946680.948503:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507206912 00000100:00100000:3.0:1783946680.948510:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507206912 00000100:00100000:3.0:1783946680.948552:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:3.0:1783946680.948561:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:5438:x1870603507206912:12345-192.168.201.18@tcp:33: 00000100:00100000:3.0:1783946680.950787:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946680.950839:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946680.950868:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507206656 00000100:00100000:3.0:1783946680.950877:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507206656 00000100:00100000:1.0:1783946680.950987:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507206784 00000100:00100000:1.0:1783946680.950992:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507206784 00000100:00100000:1.0:1783946680.951029:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:1.0:1783946680.951038:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1870603507206784:12345-192.168.201.18@tcp:8: 00010000:00080000:1.0:1783946680.951133:0:6944:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:1.0:1783946680.951164:0:6944:0:(genops.c:1406:class_connect()) connect: client c2268401-da9f-4e1e-8a1c-9473caf67cba, cookie 0x229d2ec450db724d 00002000:00100000:1.0:1783946680.951186:0:6944:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c2268401-da9f-4e1e-8a1c-9473caf67cba/ffff9137bdc78800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783946680.951205:0:6944:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783946680.951540:0:6944:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783946680.951573:0:6944:0:(import.c:65:import_set_state_nolock()) ffff9137bdc7f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783946680.951644:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2360:x1870603507206784:12345-192.168.201.18@tcp:8: Request processed in 605us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946680.951653:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1783946680.952787:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783946680.952798:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1870603507206656:12345-192.168.201.18@tcp:8: 00010000:00080000:3.0:1783946680.952823:0:6945:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:3.0:1783946680.952857:0:6945:0:(genops.c:1406:class_connect()) connect: client c2268401-da9f-4e1e-8a1c-9473caf67cba, cookie 0x229d2ec450db7254 00002000:00100000:3.0:1783946680.952867:0:6945:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c2268401-da9f-4e1e-8a1c-9473caf67cba/ffff9137a7eef800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783946680.952883:0:6945:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783946680.953040:0:6945:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783946680.953091:0:6945:0:(import.c:65:import_set_state_nolock()) ffff9137a7ee8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783946680.953144:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2360:x1870603507206656:12345-192.168.201.18@tcp:8: Request processed in 347us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946680.953151:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000004:00080000:3.0:1783946680.991979:0:5959:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43289us 00000004:00200000:3.0:1783946681.053483:0:5959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783946681.053631:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:5438:x1870603507206912:12345-192.168.201.18@tcp:33: Request processed in 105064us (106216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946681.053642:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1783946681.232462:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946681.232490:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522957440:0@lo:13: 00000100:00100000:2.0:1783946681.232560:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946681.232737:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522957440 00000100:00100000:1.0:1783946681.232745:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522957440 00000100:00100000:1.0:1783946681.232814:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783946681.232835:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522957440:12345-0@lo:13: 00002000:00000024:1.0:1783946681.232860:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946681.232924:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522957440:12345-0@lo:13: Request processed in 102us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946681.232931:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1783946681.233116:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783946681.233162:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bde8ed80 x1870603522957440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946681.233184:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522957440:0@lo:13: 00000100:00100000:1.0:1783946681.304966:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946681.305366:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507207168 00000100:00100000:3.0:1783946681.305377:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507207168 00000100:00100000:3.0:1783946681.305440:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1783946681.305450:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:5478:x1870603507207168:12345-192.168.201.18@tcp:101: 00010000:00010000:3.0:1783946681.305469:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946681.305519:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151be00/0x229d2ec450db725b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571daa expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946681.305587:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7262 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946681.305600:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946681.305614:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946681.305657:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783946681.305660:0:7190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946681.305676:0:7190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946681.305700:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151be00/0x229d2ec450db725b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571daa expref: 8 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946681.305719:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571daa expref: 7 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946681.305728:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10000) 00010000:00010000:3.0:1783946681.305731:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946681.305750:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151ae00, rc 0) 00000100:00100000:3.0:1783946681.305841:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:5478:x1870603507207168:12345-192.168.201.18@tcp:101: Request processed in 392us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946681.305850:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00010000:00010000:1.0:1783946681.489722:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946682.256373:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946682.256597:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522958080:0@lo:400: 00000100:00100000:2.0:1783946682.256668:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946682.256738:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946682.256745:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522957696:0@lo:13: 00000100:00100000:2.0:1783946682.256770:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946682.256820:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522957696 00000100:00100000:2.0:1783946682.256827:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522957696 00000100:00100000:2.0:1783946682.256894:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783946682.256904:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522957696:12345-0@lo:13: 00002000:00000024:2.0:1783946682.256933:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946682.256978:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522957696:12345-0@lo:13: Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946682.256985:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1783946682.257018:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783946682.257044:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdee7800 x1870603522957696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946682.257107:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522957696:0@lo:13: 00000100:00100000:2.0:1783946682.257139:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522957824:0@lo:400: 00000100:00100000:2.0:1783946682.257182:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946682.257204:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946682.257209:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522957952:0@lo:400: 00000100:00100000:2.0:1783946682.257230:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946682.257271:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522957824 00000100:00100000:2.0:1783946682.257275:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522957824 00000100:00100000:2.0:1783946682.257301:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522957952 00000100:00100000:2.0:1783946682.257304:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522957952 00000100:00100000:2.0:1783946682.257327:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783946682.257333:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522957824:12345-0@lo:400: 00000100:00100000:2.0:1783946682.257369:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522957824:12345-0@lo:400: Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946682.257382:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783946682.257395:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783946682.257401:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522957952:12345-0@lo:400: 00000100:00100000:2.0:1783946682.257431:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522957952:12345-0@lo:400: Request processed in 31us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946682.257436:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1783946682.257454:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946682.257470:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522957952:0@lo:400: 00000100:00100000:2.0:1783946682.257478:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522957824:0@lo:400: 00000100:00100000:2.0:1783946682.257527:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522958080 00000100:00100000:2.0:1783946682.257531:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522958080 00000100:00100000:2.0:1783946682.257554:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783946682.257561:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522958080:12345-0@lo:400: 00000100:00100000:2.0:1783946682.257595:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522958080:12345-0@lo:400: Request processed in 35us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946682.257601:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783946682.257624:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bde8ce00 x1870603522958080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946682.257634:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522958080:0@lo:400: 00000100:00100000:3.0:1783946682.259185:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522957568:0@lo:400: 00000100:00100000:3.0:1783946682.259316:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946682.259694:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522957568 00000100:00100000:2.0:1783946682.259703:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522957568 00000100:00100000:2.0:1783946682.259760:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783946682.259769:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522957568:12345-0@lo:400: 00000100:00100000:2.0:1783946682.260180:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522957568:12345-0@lo:400: Request processed in 410us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946682.260203:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783946682.262590:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946682.262618:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522958208:0@lo:400: 00000100:00100000:2.0:1783946682.262689:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946682.262789:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522958208 00000100:00100000:0.0:1783946682.262797:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522958208 00000100:00100000:0.0:1783946682.262874:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783946682.263357:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522957568:0@lo:400: 00000100:00080000:2.0:1783946682.263360:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946682.263608:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522958208:12345-0@lo:400: 00000100:00100000:0.0:1783946682.263691:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522958208:12345-0@lo:400: Request processed in 808us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946682.263700:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783946682.263841:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522958208:0@lo:400: 00010000:00010000:2.0:1783946682.512577:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946683.537443:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946684.145655:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946684.145784:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507207296 00000100:00100000:1.0:1783946684.145794:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507207296 00000100:00100000:1.0:1783946684.145895:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:1.0:1783946684.145907:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:5530:x1870603507207296:12345-192.168.201.18@tcp:41: 00000004:00000024:1.0:1783946684.145952:0:5958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1783946684.146051:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:5530:x1870603507207296:12345-192.168.201.18@tcp:41: Request processed in 146us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946684.146125:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00080000:2.0:1783946684.147288:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946684.150185:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946684.150361:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507207424 00000100:00100000:2.0:1783946684.150376:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507207424 00000100:00100000:2.0:1783946684.150476:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1783946684.150491:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:5530:x1870603507207424:12345-192.168.201.18@tcp:13: 00002000:00000024:2.0:1783946684.150537:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946684.150643:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:5530:x1870603507207424:12345-192.168.201.18@tcp:13: Request processed in 157us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946684.150652:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00080000:0.0:1783946684.153581:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946684.154146:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946684.155235:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507207552 00000100:00100000:2.0:1783946684.155252:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507207552 00000100:00100000:2.0:1783946684.155366:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:2.0:1783946684.155380:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:5530:x1870603507207552:12345-192.168.201.18@tcp:13: 00002000:00000024:2.0:1783946684.155463:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946684.155578:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:5530:x1870603507207552:12345-192.168.201.18@tcp:13: Request processed in 200us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946684.155588:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00080000:0.0:1783946684.157405:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783946684.560448:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783946684.825709:0:8015:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00010000:00010000:2.0:1783946685.586848:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783946685.845785:0:5935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000100:00100000:1.0:1783946686.334134:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946686.334178:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946686.334218:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946686.334254:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946686.334334:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507207808 00000100:00100000:0.0:1783946686.334343:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507207808 00000100:00100000:0.0:1783946686.334423:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:0.0:1783946686.334434:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507207808:12345-192.168.201.18@tcp:400: 00000100:00100000:0.0:1783946686.334524:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507207808:12345-192.168.201.18@tcp:400: Request processed in 91us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946686.334532:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:2.0:1783946686.334674:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507207680 00000100:00100000:2.0:1783946686.334679:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507207680 00000100:00100000:2.0:1783946686.334716:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:2.0:1783946686.334723:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2363:x1870603507207680:12345-192.168.201.18@tcp:400: 00000100:00100000:2.0:1783946686.334752:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2363:x1870603507207680:12345-192.168.201.18@tcp:400: Request processed in 30us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946686.334759:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:2.0:1783946686.334800:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507207936 00000100:00100000:2.0:1783946686.334804:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507207936 00000100:00100000:2.0:1783946686.334830:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507208064 00000100:00100000:2.0:1783946686.334833:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507208064 00000100:00100000:2.0:1783946686.334850:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:2.0:1783946686.334856:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507207936:12345-192.168.201.18@tcp:400: 00000100:00100000:2.0:1783946686.334880:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507207936:12345-192.168.201.18@tcp:400: Request processed in 24us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946686.334886:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:2.0:1783946686.334896:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1783946686.334902:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507208064:12345-192.168.201.18@tcp:400: 00000100:00100000:2.0:1783946686.334923:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507208064:12345-192.168.201.18@tcp:400: Request processed in 21us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946686.334929:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00080000:1.0:1783946686.335236:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783946686.335241:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783946686.335244:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946686.353279:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783946686.353311:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522958336:0@lo:13: 00000100:00100000:0.0:1783946686.353392:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946686.353741:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522958336 00000100:00100000:1.0:1783946686.353749:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522958336 00000100:00100000:1.0:1783946686.353821:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783946686.353830:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522958336:12345-0@lo:13: 00002000:00000024:1.0:1783946686.353860:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946686.353912:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522958336:12345-0@lo:13: Request processed in 82us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946686.353920:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1783946686.353963:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bde8f100 x1870603522958336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946686.353980:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522958336:0@lo:13: 00000100:00080000:0.0:1783946686.354643:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783946686.608319:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783946686.874654:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000100:00100000:1.0:1783946687.385277:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522958464:0@lo:13: 00000100:00100000:1.0:1783946687.385351:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946687.385431:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522958464 00000100:00100000:1.0:1783946687.385438:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522958464 00000100:00100000:1.0:1783946687.385508:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783946687.385518:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522958464:12345-0@lo:13: 00002000:00000024:1.0:1783946687.385549:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946687.385856:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522958464:12345-0@lo:13: Request processed in 338us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946687.385864:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1783946687.385886:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783946687.385918:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bde8f100 x1870603522958464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946687.385938:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522958464:0@lo:13: 00000100:00100000:2.0:1783946687.393509:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522958848:0@lo:400: 00000100:00100000:2.0:1783946687.393590:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946687.393642:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946687.393648:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522958976:0@lo:400: 00000100:00100000:2.0:1783946687.393675:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946687.393707:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522958976 00000100:00100000:2.0:1783946687.393714:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522958976 00000100:00100000:2.0:1783946687.393762:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783946687.393771:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522958976:12345-0@lo:400: 00000100:00100000:2.0:1783946687.393819:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522958976:12345-0@lo:400: Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946687.393826:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1783946687.393866:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdd6df80 x1870603522958976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946687.393879:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522958976:0@lo:400: 00000100:00100000:3.0:1783946687.398241:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522958592:0@lo:400: 00000100:00100000:3.0:1783946687.398321:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946687.398376:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522959104:0@lo:400: 00000100:00100000:3.0:1783946687.398403:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946687.398440:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783946687.398447:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522958720:0@lo:400: 00000100:00100000:3.0:1783946687.398479:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946687.398519:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522958592 00000100:00100000:3.0:1783946687.398526:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522958592 00000100:00100000:3.0:1783946687.398582:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783946687.398591:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522958592:12345-0@lo:400: 00000100:00100000:3.0:1783946687.398659:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522958592:12345-0@lo:400: Request processed in 68us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946687.398666:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783946687.398699:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522958848 00000100:00100000:3.0:1783946687.398703:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522958848 00000100:00100000:3.0:1783946687.398755:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522959104 00000100:00100000:3.0:1783946687.398758:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522959104 00000100:00100000:3.0:1783946687.398771:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522958720 00000100:00100000:3.0:1783946687.398774:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522958720 00000100:00100000:3.0:1783946687.398785:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783946687.398790:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522958848:12345-0@lo:400: 00000100:00100000:3.0:1783946687.398829:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522958848:12345-0@lo:400: Request processed in 38us (5239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946687.398835:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783946687.398848:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783946687.398853:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522959104:12345-0@lo:400: 00000100:00100000:3.0:1783946687.398876:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522959104:12345-0@lo:400: Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946687.398881:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783946687.398891:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783946687.398896:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522958720:12345-0@lo:400: 00000100:00100000:3.0:1783946687.398920:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522958720:12345-0@lo:400: Request processed in 23us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946687.398925:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783946687.398993:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522958848:0@lo:400: 00000100:00080000:3.0:1783946687.399016:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946687.399034:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522958720:0@lo:400: 00000100:00100000:3.0:1783946687.399044:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522958592:0@lo:400: 00000100:00100000:3.0:1783946687.399052:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522959104:0@lo:400: 00010000:00010000:2.0:1783946687.632341:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783946687.741639:0:8679:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1783946688.656431:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946689.681893:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946690.705422:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946691.441672:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946691.441727:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946691.442273:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507208192 00000100:00100000:0.0:1783946691.442285:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507208192 00000100:00100000:0.0:1783946691.442351:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 133 00000100:00100000:0.0:1783946691.442362:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2361:x1870603507208192:12345-192.168.201.18@tcp:400: 00000100:00100000:0.0:1783946691.442459:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2361:x1870603507208192:12345-192.168.201.18@tcp:400: Request processed in 98us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946691.442467:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 133 00000100:00100000:1.0:1783946691.442729:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507208448 00000100:00100000:1.0:1783946691.442752:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507208448 00000100:00100000:1.0:1783946691.442848:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:1.0:1783946691.442864:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507208448:12345-192.168.201.18@tcp:400: 00000100:00080000:2.0:1783946691.442877:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946691.442968:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507208448:12345-192.168.201.18@tcp:400: Request processed in 109us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946691.442977:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783946691.447187:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946691.447227:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946691.447386:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507208320 00000100:00100000:0.0:1783946691.447396:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507208320 00000100:00100000:0.0:1783946691.447487:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1783946691.447498:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507208320:12345-192.168.201.18@tcp:400: 00000100:00100000:0.0:1783946691.447587:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507208320:12345-192.168.201.18@tcp:400: Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946691.447608:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00080000:3.0:1783946691.447672:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946691.451826:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507208576 00000100:00100000:2.0:1783946691.451844:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507208576 00000100:00100000:2.0:1783946691.451948:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1783946691.451960:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507208576:12345-192.168.201.18@tcp:400: 00000100:00100000:2.0:1783946691.452303:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507208576:12345-192.168.201.18@tcp:400: Request processed in 343us (5073us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946691.452312:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00080000:3.0:1783946691.457359:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783946691.473144:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522959232:0@lo:13: 00000100:00100000:0.0:1783946691.473266:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946691.473340:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522959232 00000100:00100000:1.0:1783946691.473357:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522959232 00000100:00080000:0.0:1783946691.473418:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946691.473462:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783946691.473477:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522959232:12345-0@lo:13: 00002000:00000024:1.0:1783946691.473513:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946691.473609:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522959232:12345-0@lo:13: Request processed in 136us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946691.473617:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1783946691.473795:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bde8f100 x1870603522959232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946691.473816:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522959232:0@lo:13: 00010000:00010000:2.0:1783946691.728375:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946692.497856:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522959360:0@lo:400: 00000100:00100000:3.0:1783946692.497942:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946692.497996:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522959872:0@lo:400: 00000100:00100000:3.0:1783946692.498036:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946692.498091:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783946692.498097:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522959488:0@lo:400: 00000100:00100000:3.0:1783946692.498122:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946692.498139:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522960000:0@lo:400: 00000100:00100000:3.0:1783946692.498161:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946692.498192:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522959616:0@lo:400: 00000100:00100000:3.0:1783946692.498215:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946692.498233:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783946692.498237:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522959744:0@lo:400: 00000100:00100000:3.0:1783946692.498257:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946692.498291:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522959360 00000100:00100000:3.0:1783946692.498298:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522959360 00000100:00100000:3.0:1783946692.498340:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783946692.498349:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522959360:12345-0@lo:400: 00000100:00100000:3.0:1783946692.498395:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522959360:12345-0@lo:400: Request processed in 47us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946692.498402:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783946692.498448:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522959360:0@lo:400: 00000100:00100000:0.0:1783946692.501835:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522960000 00000100:00100000:0.0:1783946692.501850:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522960000 00000100:00100000:0.0:1783946692.501933:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522959744 00000100:00100000:0.0:1783946692.501937:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522959744 00000100:00100000:0.0:1783946692.501956:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783946692.501965:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522960000:12345-0@lo:400: 00000100:00100000:0.0:1783946692.502078:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522960000:12345-0@lo:400: Request processed in 96us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946692.502087:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783946692.502105:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783946692.502111:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522959744:12345-0@lo:400: 00000100:00100000:0.0:1783946692.502149:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522959744:12345-0@lo:400: Request processed in 39us (3891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946692.502156:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1783946692.502178:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783946692.502215:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23ca80 x1870603522960000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946692.502230:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522960000:0@lo:400: 00010000:00080000:0.0:1783946692.502289:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23f480 x1870603522959744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946692.502298:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522959744:0@lo:400: 00000100:00100000:0.0:1783946692.502353:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522959872 00000100:00100000:0.0:1783946692.502357:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522959872 00000100:00100000:0.0:1783946692.502396:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522959488 00000100:00100000:0.0:1783946692.502399:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522959488 00000100:00100000:0.0:1783946692.502408:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522959616 00000100:00100000:0.0:1783946692.502411:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522959616 00000100:00100000:0.0:1783946692.502424:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783946692.502430:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522959872:12345-0@lo:400: 00000100:00100000:0.0:1783946692.502467:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522959872:12345-0@lo:400: Request processed in 37us (4432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946692.502473:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783946692.502484:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783946692.502489:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522959488:12345-0@lo:400: 00000100:00100000:0.0:1783946692.502516:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522959488:12345-0@lo:400: Request processed in 28us (4394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946692.502535:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783946692.502546:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783946692.502552:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522959616:12345-0@lo:400: 00000100:00100000:0.0:1783946692.502582:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522959616:12345-0@lo:400: Request processed in 30us (4366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946692.502588:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1783946692.502607:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946692.502625:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522959616:0@lo:400: 00000100:00100000:0.0:1783946692.502664:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522959488:0@lo:400: 00000100:00100000:0.0:1783946692.502926:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522959872:0@lo:400: 00000100:00100000:2.0:1783946692.504185:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946692.504205:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522960128:0@lo:13: 00000100:00100000:2.0:1783946692.504262:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946692.504307:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522960128 00000100:00100000:2.0:1783946692.504314:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522960128 00000100:00100000:2.0:1783946692.504368:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783946692.504378:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522960128:12345-0@lo:13: 00002000:00000024:2.0:1783946692.504409:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946692.504451:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522960128:12345-0@lo:13: Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946692.504458:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1783946692.504494:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdd6df80 x1870603522960128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946692.504513:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522960128:0@lo:13: 00000020:00000080:2.0:1783946692.664357:0:8826:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec4bb8600 20000000:00000080:2.0:1783946692.664378:0:8826:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9137bdc81800 uarg=0000000000000000 20000000:01000000:2.0:1783946692.664421:0:8826:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783946692.664423:0:8826:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783946692.664426:0:8826:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783946692.664430:0:8826:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783946692.664436:0:8826:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783946692.664501:0:8826:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783946692.664504:0:8826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783946692.665331:0:8827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1783946692.665584:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1783946692.665615:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1783946692.665632:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1783946692.665642:0:8826:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783946692.665644:0:8826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783946692.665945:0:8828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1783946692.666248:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1783946692.666277:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1783946692.666290:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1783946692.666299:0:8826:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783946692.666301:0:8826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783946692.666552:0:8829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1783946692.666699:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1783946692.666720:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1783946692.666734:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1783946692.666744:0:8826:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783946692.666746:0:8826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783946692.667182:0:8830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1783946692.667332:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1783946692.667353:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1783946692.667368:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1783946692.667380:0:8826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783946692.667401:0:8826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667420:0:8826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db715f expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667428:0:8826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7189 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667435:0:8826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db71b3 expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667442:0:8826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db71c1 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667448:0:8826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db71cf expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667455:0:8826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db71eb expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667472:0:8826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7215 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667483:0:8826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d48 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667490:0:8826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d4f expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667499:0:8826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667542:0:8826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d4f expref: 9 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667557:0:8826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d4f expref: 9 pid: 5951 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.667572:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960256:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946692.667728:0:8826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d48 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667737:0:8826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d48 expref: 9 pid: 5949 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.667747:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960384:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946692.667782:0:8826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7215 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667803:0:8826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7215 expref: 18 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.667813:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960512:0@lo:104: 00000100:00100000:2.0:1783946692.667854:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783946692.667903:0:8826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db71eb expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667911:0:8826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db71eb expref: 18 pid: 5949 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.667919:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960640:0@lo:104: 00000100:00100000:2.0:1783946692.667942:0:8826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783946692.667967:0:8826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db71cf expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.667987:0:8826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db71cf expref: 18 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.667995:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960768:0@lo:104: 00010000:00010000:2.0:1783946692.668021:0:8826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db71c1 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.668028:0:8826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db71c1 expref: 18 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.668035:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960896:0@lo:104: 00010000:00010000:2.0:1783946692.668085:0:8826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db71b3 expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.668101:0:8826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db71b3 expref: 18 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.668110:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522961024:0@lo:104: 00010000:00010000:2.0:1783946692.668139:0:8826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7189 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.668148:0:8826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7189 expref: 18 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.668156:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522961152:0@lo:104: 00010000:00010000:2.0:1783946692.668177:0:8826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db715f expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.668185:0:8826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db715f expref: 18 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.668194:0:8826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522961280:0@lo:104: 00000100:00100000:2.0:1783946692.668210:0:8826:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053900 going to sleep for 11 seconds 00000100:00100000:1.0:1783946692.668375:0:5940:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783946692.668401:0:5940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946692.668415:0:5940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946692.668424:0:5940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946692.668432:0:5940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946692.668439:0:5940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946692.668447:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522960512 00000100:00100000:1.0:1783946692.668454:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522960512 00000100:00100000:1.0:1783946692.668489:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522960640 00000100:00100000:1.0:1783946692.668492:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522960640 00000100:00100000:1.0:1783946692.668502:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522960768 00000100:00100000:1.0:1783946692.668505:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522960768 00000100:00100000:1.0:1783946692.668512:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522960896 00000100:00100000:1.0:1783946692.668514:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522960896 00000100:00100000:1.0:1783946692.668521:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522961024 00000100:00100000:1.0:1783946692.668523:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522961024 00000100:00100000:1.0:1783946692.668531:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522961152 00000100:00100000:1.0:1783946692.668533:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522961152 00000100:00100000:1.0:1783946692.668541:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522961280 00000100:00100000:1.0:1783946692.668543:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522961280 00000100:00100000:1.0:1783946692.668555:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783946692.668562:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:8826:x1870603522960512:12345-0@lo:104: 00010000:00010000:1.0:1783946692.668575:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.668628:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783946692.668634:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+9:8826:x1870603522960512:12345-0@lo:104: Request processed in 72us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946692.668641:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783946692.668656:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783946692.668662:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdce5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+8:8826:x1870603522960640:12345-0@lo:104: 00010000:00010000:1.0:1783946692.668669:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.668708:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783946692.668714:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdce5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+8:8826:x1870603522960640:12345-0@lo:104: Request processed in 52us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946692.668720:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783946692.668752:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783946692.668760:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+7:8826:x1870603522960768:12345-0@lo:104: 00010000:00010000:1.0:1783946692.668768:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.668793:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783946692.668797:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+7:8826:x1870603522960768:12345-0@lo:104: Request processed in 40us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946692.668802:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783946692.668812:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783946692.668818:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+6:8826:x1870603522960896:12345-0@lo:104: 00010000:00010000:1.0:1783946692.668824:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.668848:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783946692.668852:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+6:8826:x1870603522960896:12345-0@lo:104: Request processed in 35us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946692.668856:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783946692.668868:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783946692.668873:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:8826:x1870603522961024:12345-0@lo:104: 00010000:00010000:1.0:1783946692.668893:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.668928:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783946692.668933:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:8826:x1870603522961024:12345-0@lo:104: Request processed in 60us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946692.668939:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783946692.668951:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783946692.668956:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:8826:x1870603522961152:12345-0@lo:104: 00010000:00010000:1.0:1783946692.668963:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669085:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1783946692.669091:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:8826:x1870603522961152:12345-0@lo:104: Request processed in 135us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946692.669097:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783946692.669109:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783946692.669114:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:8826:x1870603522961280:12345-0@lo:104: 00010000:00010000:1.0:1783946692.669121:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669146:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1783946692.669150:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:8826:x1870603522961280:12345-0@lo:104: Request processed in 37us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946692.669155:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1783946692.669174:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783946692.669181:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669188:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45800 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946692.669199:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669209:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946692.669216:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946692.669222:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946692.669258:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669265:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946692.669286:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669293:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7215 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db721c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669308:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783946692.669311:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669318:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151ba00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946692.669321:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669328:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946692.669344:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946692.669349:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946692.669364:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669369:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946692.669389:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669396:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db71eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71f2 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669407:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783946692.669410:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669415:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bee00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946692.669418:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669424:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946692.669430:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946692.669434:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946692.669452:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669458:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946692.669463:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669469:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db71cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71d6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669479:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783946692.669482:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669488:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44800 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946692.669491:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669498:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946692.669504:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946692.669509:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946692.669521:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669528:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946692.669532:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669549:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137b9f44800/0x229d2ec450db71c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71c8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669559:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783946692.669562:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669568:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45a00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946692.669571:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669578:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946692.669584:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946692.669589:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946692.669602:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669608:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946692.669612:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669618:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db71b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db71ba expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669628:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783946692.669636:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669641:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946692.669643:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669650:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946692.669655:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946692.669660:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946692.669675:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669681:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946692.669685:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669691:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35be000/0x229d2ec450db7189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7190 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669699:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946692.669702:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669707:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be800 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946692.669710:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669727:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946692.669733:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946692.669738:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783946692.669752:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669758:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946692.669761:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669768:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35be800/0x229d2ec450db715f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7166 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.669782:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946692.669784:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946692.669785:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946692.669793:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946692.669816:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522961408:0@lo:103: 00000100:00100000:1.0:1783946692.669856:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946692.669901:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522961920:0@lo:103: 00000100:00100000:1.0:1783946692.669921:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946692.669941:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783946692.669947:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522961792:0@lo:103: 00000100:00100000:1.0:1783946692.669966:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946692.670210:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522961408 00000100:00100000:2.0:1783946692.670219:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522961408 00010000:00010000:2.0:1783946692.670248:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7215 expref: 19 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.670268:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522961920 00000100:00100000:2.0:1783946692.670270:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522961920 00010000:00010000:2.0:1783946692.670280:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db71b3 expref: 20 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.670308:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783946692.670314:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+20:3448:x1870603522961408:12345-0@lo:103: 00010000:00010000:2.0:1783946692.670327:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946692.670333:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7215 expref: 20 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.670342:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7215 expref: 20 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.670358:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946692.670386:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+20:3448:x1870603522961408:12345-0@lo:103: Request processed in 71us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946692.670393:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783946692.670409:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783946692.670415:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522961920:12345-0@lo:103: 00010000:00010000:2.0:1783946692.670423:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946692.670427:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db71b3 expref: 19 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.670435:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db71b3 expref: 19 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.670445:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946692.670468:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522961920:12345-0@lo:103: Request processed in 53us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946692.670473:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1783946692.670515:0:8826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797623800/0x229d2ec450db721c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7215 expref: 18 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.670533:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960512:0@lo:104: 00000100:00100000:2.0:1783946692.670547:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960640:0@lo:104: 00000100:00100000:2.0:1783946692.670555:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960768:0@lo:104: 00000100:00100000:2.0:1783946692.670562:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960896:0@lo:104: 00010000:00010000:2.0:1783946692.670570:0:8826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622800/0x229d2ec450db71ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db71b3 expref: 17 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.670579:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522961024:0@lo:104: 00000100:00100000:2.0:1783946692.670588:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522961152:0@lo:104: 00000100:00100000:2.0:1783946692.670595:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522961280:0@lo:104: 00000100:00100000:1.0:1783946692.670749:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522961408:0@lo:103: 00000100:00100000:1.0:1783946692.670756:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522961920:0@lo:103: 00000100:00100000:1.0:1783946692.670787:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522961536:0@lo:103: 00000100:00100000:1.0:1783946692.670813:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946692.670886:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522962048:0@lo:103: 00000100:00100000:1.0:1783946692.670906:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946692.671152:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522961664:0@lo:103: 00000100:00100000:0.0:1783946692.672543:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522961792 00000100:00100000:0.0:1783946692.672554:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522961792 00010000:00010000:0.0:1783946692.672594:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db71c1 expref: 17 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946692.672620:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522961536 00000100:00100000:0.0:1783946692.672624:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522961536 00010000:00010000:0.0:1783946692.672637:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db71eb expref: 18 pid: 5949 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946692.672647:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522962048 00000100:00100000:0.0:1783946692.672649:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522962048 00010000:00010000:0.0:1783946692.672660:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7189 expref: 19 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946692.672674:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783946692.672683:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522961792:12345-0@lo:103: 00010000:00010000:0.0:1783946692.672695:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946692.672701:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db71c1 expref: 19 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.672711:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db71c1 expref: 19 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.672731:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db71c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db71c1 expref: 19 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.672747:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946692.672821:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:3448:x1870603522961792:12345-0@lo:103: Request processed in 138us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946692.672829:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783946692.672849:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783946692.672854:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:3449:x1870603522961536:12345-0@lo:103: 00010000:00010000:0.0:1783946692.672863:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946692.672868:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db71eb expref: 17 pid: 5949 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.672886:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db71eb expref: 17 pid: 5949 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.672896:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f44600/0x229d2ec450db71f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db71eb expref: 17 pid: 5949 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.672913:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946692.672948:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3449:x1870603522961536:12345-0@lo:103: Request processed in 93us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946692.672955:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783946692.672969:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783946692.673641:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:3449:x1870603522962048:12345-0@lo:103: 00010000:00010000:0.0:1783946692.673653:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946692.673660:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7189 expref: 15 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.673669:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7189 expref: 15 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.673680:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622000/0x229d2ec450db7190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7189 expref: 15 pid: 5951 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.673701:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946692.673735:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:3449:x1870603522962048:12345-0@lo:103: Request processed in 100us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946692.673742:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783946692.674219:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522961792:0@lo:103: 00000100:00100000:1.0:1783946692.674333:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522961536:0@lo:103: 00000100:00100000:1.0:1783946692.674343:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522962048:0@lo:103: 00000100:00100000:1.0:1783946692.674803:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946692.674828:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507208704 00000100:00100000:1.0:1783946692.674837:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507208704 00010000:00010000:1.0:1783946692.674892:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d4f expref: 10 pid: 5951 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946692.674923:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1783946692.674932:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2361:x1870603507208704:12345-192.168.201.18@tcp:103: 00010000:00010000:1.0:1783946692.674947:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946692.674953:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d4f expref: 10 pid: 5951 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.674965:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d4f expref: 10 pid: 5951 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946692.675312:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960256:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946692.675322:0:8826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8826:1870603522960384:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946692.675560:0:8826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946692.675731:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946692.675787:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522962176:0@lo:103: 00000100:00100000:3.0:1783946692.675835:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946692.676044:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522961664 00000100:00100000:2.0:1783946692.676050:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522961664 00010000:00010000:2.0:1783946692.676129:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db71cf expref: 14 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.676145:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522962176 00000100:00100000:2.0:1783946692.676148:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522962176 00010000:00010000:2.0:1783946692.676158:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db715f expref: 15 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.676171:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783946692.676177:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3530850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:3450:x1870603522961664:12345-0@lo:103: 00010000:00010000:2.0:1783946692.676187:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946692.676191:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db71cf expref: 15 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.676219:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db71cf expref: 15 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.676235:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bf600/0x229d2ec450db71d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db71cf expref: 15 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.676250:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946692.676284:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3530850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:3450:x1870603522961664:12345-0@lo:103: Request processed in 107us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946692.676291:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783946692.676308:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783946692.676314:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:3450:x1870603522962176:12345-0@lo:103: 00010000:00010000:2.0:1783946692.676322:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946692.676326:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db715f expref: 13 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.676334:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db715f expref: 13 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.676343:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f45c00/0x229d2ec450db7166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db715f expref: 13 pid: 5950 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.676353:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946692.677194:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522961664:0@lo:103: 00000100:00100000:3.0:1783946692.677203:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522962176:0@lo:103: 00000100:00100000:0.0:1783946692.677322:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946692.677382:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:3450:x1870603522962176:12345-0@lo:103: Request processed in 60us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946692.677389:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783946692.677406:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507208832 00000100:00100000:2.0:1783946692.677411:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507208832 00010000:00010000:2.0:1783946692.677441:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d48 expref: 11 pid: 5949 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946692.677458:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:2.0:1783946692.677466:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:2361:x1870603507208832:12345-192.168.201.18@tcp:103: 00010000:00010000:2.0:1783946692.677476:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946692.677481:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d48 expref: 11 pid: 5949 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.677491:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d48 expref: 11 pid: 5949 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.677505:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bf400/0x229d2ec450db722a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d48 expref: 11 pid: 5949 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.677652:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91378151bc00/0x229d2ec450db7231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d4f expref: 10 pid: 5951 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.677679:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.677687:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.677703:0:5942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.677710:0:5942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.677718:0:5942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.677726:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.677733:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622400 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946692.677737:0:5942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.677744:0:5942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946692.677862:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946692.678043:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:2361:x1870603507208832:12345-192.168.201.18@tcp:103: Request processed in 576us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946692.678050:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00010000:00010000:0.0:1783946692.679227:0:8826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946692.679241:0:8826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.694256:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.694279:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622400/0x229d2ec450db7269 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946692.694326:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946692.698264:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:2361:x1870603507208704:12345-192.168.201.18@tcp:103: Request processed in 23318us (23448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946692.698282:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00010000:00010000:2.0:1783946692.752289:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946693.776384:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783946694.672414:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783946694.672423:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9137a7c0f800 from 39 10000000:01000000:2.0:1783946694.672428:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783946694.672520:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.672532:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.672544:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946694.672584:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522962304:0@lo:101: 00000100:00100000:2.0:1783946694.672661:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.672743:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053240 going to sleep for 11 seconds 00000100:00100000:3.0:1783946694.673719:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522962304 00000100:00100000:3.0:1783946694.673728:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522962304 00000100:00100000:3.0:1783946694.673792:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783946694.673802:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+12:5953:x1870603522962304:12345-0@lo:101: 00010000:00010000:3.0:1783946694.673818:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946694.673838:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91378151be00/0x229d2ec450db7277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7270 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946694.673886:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91378151be00/0x229d2ec450db7277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7270 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946694.673897:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91378151be00/0x229d2ec450db7277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7270 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946694.673906:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151be00, rc 0) 00000100:00100000:3.0:1783946694.673974:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522962304:12345-0@lo:101: Request processed in 174us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946694.673982:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783946694.674778:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522962304:0@lo:101: 00010000:00010000:2.0:1783946694.674800:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.674810:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946694.674915:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522962432:0@lo:501: 00000100:00100000:2.0:1783946694.674958:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.674997:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053240 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.675103:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522962432 00000100:00100000:0.0:1783946694.675109:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522962432 00000100:00100000:0.0:1783946694.675148:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783946694.675157:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522962432:12345-0@lo:501: 00000100:00100000:0.0:1783946694.675289:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522962432:12345-0@lo:501: Request processed in 132us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.675296:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783946694.675459:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522962432:0@lo:501: 00000100:00100000:2.0:1783946694.675724:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522962560:0@lo:503: 00000100:00100000:2.0:1783946694.675770:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.675796:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053240 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.676026:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522962560 00000100:00100000:0.0:1783946694.676031:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522962560 00000100:00100000:0.0:1783946694.676100:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783946694.676108:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522962560:12345-0@lo:503: 00000100:00100000:0.0:1783946694.676204:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522962560:12345-0@lo:503: Request processed in 96us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.676211:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783946694.676721:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522962560:0@lo:503: 00000100:00100000:2.0:1783946694.678106:0:8843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8843:1870603522962688:0@lo:502: 00000100:00100000:2.0:1783946694.678183:0:8843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.678224:0:8843:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053180 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.678385:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522962688 00000100:00100000:0.0:1783946694.678392:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522962688 00000100:00100000:0.0:1783946694.678469:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783946694.678491:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8843:x1870603522962688:12345-0@lo:502: 00000100:00100000:0.0:1783946694.678605:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8843:x1870603522962688:12345-0@lo:502: Request processed in 115us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.678612:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783946694.678682:0:8843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8843:1870603522962688:0@lo:502: 00000100:00100000:2.0:1783946694.678718:0:8843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8843:1870603522962816:0@lo:502: 00000100:00100000:2.0:1783946694.678751:0:8843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.691999:0:8843:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053180 going to sleep for 11 seconds 00000100:00100000:1.0:1783946694.706094:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522962816 00000100:00100000:1.0:1783946694.706109:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522962816 00000100:00100000:1.0:1783946694.706247:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783946694.706256:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8843:x1870603522962816:12345-0@lo:502: 00000100:00100000:1.0:1783946694.706594:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:8843:x1870603522962816:12345-0@lo:502: Request processed in 338us (27841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946694.706603:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783946694.707276:0:8843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8843:1870603522962816:0@lo:502: 00000040:00080000:2.0:1783946694.707317:0:8843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783946694.708234:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783946694.708261:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783946694.708273:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946694.708284:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946694.708294:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783946694.708297:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1783946694.708300:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783946694.708337:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946694.708345:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946694.708374:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946694.708397:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522962944:0@lo:101: 00000100:00100000:1.0:1783946694.708737:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946694.708853:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9bda840 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.709985:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522962944 00000100:00100000:0.0:1783946694.709996:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522962944 00000100:00100000:0.0:1783946694.710308:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783946694.710319:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+13:5953:x1870603522962944:12345-0@lo:101: 00010000:00010000:0.0:1783946694.710336:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946694.710354:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bec00/0x229d2ec450db7285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db727e expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.710380:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bec00/0x229d2ec450db7285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db727e expref: 14 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.710392:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bec00/0x229d2ec450db7285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db727e expref: 14 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.710402:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bec00, rc 0) 00000100:00100000:0.0:1783946694.710709:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522962944:12345-0@lo:101: Request processed in 160us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.710730:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783946694.710825:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522962944:0@lo:101: 00010000:00010000:1.0:1783946694.710856:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946694.710866:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946694.710949:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963072:0@lo:501: 00000100:00100000:1.0:1783946694.710980:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946694.711522:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9bda840 going to sleep for 11 seconds 00000100:00100000:3.0:1783946694.711735:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522963072 00000100:00100000:3.0:1783946694.711741:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522963072 00000100:00100000:3.0:1783946694.711772:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783946694.711789:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522963072:12345-0@lo:501: 00000100:00100000:3.0:1783946694.711952:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522963072:12345-0@lo:501: Request processed in 164us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946694.711960:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783946694.712277:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963072:0@lo:501: 00000100:00100000:1.0:1783946694.712314:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963200:0@lo:503: 00000100:00100000:1.0:1783946694.712360:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946694.712390:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9bda840 going to sleep for 11 seconds 00000100:00100000:3.0:1783946694.712444:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522963200 00000100:00100000:3.0:1783946694.712683:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522963200 00000100:00100000:3.0:1783946694.712710:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783946694.712717:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522963200:12345-0@lo:503: 00000100:00100000:3.0:1783946694.715351:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522963200:12345-0@lo:503: Request processed in 2624us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946694.715366:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783946694.716864:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963200:0@lo:503: 00000100:00100000:0.0:1783946694.717806:0:8844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8844:1870603522963328:0@lo:502: 00000100:00100000:0.0:1783946694.717971:0:8844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.718195:0:8844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:2.0:1783946694.718309:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522963328 00000100:00100000:2.0:1783946694.718317:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522963328 00000100:00100000:3.0:1783946694.718424:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783946694.718436:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8844:x1870603522963328:12345-0@lo:502: 00000100:00100000:3.0:1783946694.718655:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8844:x1870603522963328:12345-0@lo:502: Request processed in 221us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946694.718663:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783946694.719143:0:8844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8844:1870603522963328:0@lo:502: 00000020:01000000:0.0:1783946694.719182:0:8844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946694.719193:0:8844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946694.719196:0:8844:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783946694.719202:0:8844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783946694.719234:0:8844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8844:1870603522963456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.719284:0:8844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.719390:0:8844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be32f300 going to sleep for 11 seconds 00000100:00100000:2.0:1783946694.719644:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522963456 00000100:00100000:2.0:1783946694.719649:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522963456 00000100:00100000:2.0:1783946694.719679:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783946694.719687:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8844:x1870603522963456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946694.719775:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:8844:x1870603522963456:12345-0@lo:502:llog_process_th.0 Request processed in 88us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946694.719782:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783946694.719897:0:8844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8844:1870603522963456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783946694.719917:0:8844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946694.719923:0:8844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946694.719925:0:8844:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783946694.719929:0:8844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1783946694.720374:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783946694.720404:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783946694.720415:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.720428:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946694.720439:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783946694.720442:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9137b63de800 from 39 10000000:01000000:2.0:1783946694.720445:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783946694.720483:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.720491:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.720800:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946694.720820:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783946694.720889:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.720931:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053180 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.721040:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522963584 00000100:00100000:0.0:1783946694.721046:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522963584 00000100:00100000:0.0:1783946694.721101:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783946694.721109:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:5953:x1870603522963584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946694.721119:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946694.721131:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bfc00/0x229d2ec450db7293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db728c expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.721154:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bfc00/0x229d2ec450db7293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db728c expref: 15 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.721176:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bfc00/0x229d2ec450db7293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db728c expref: 15 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.721186:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bfc00, rc 0) 00000100:00100000:0.0:1783946694.721226:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522963584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.721232:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783946694.721432:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946694.721445:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.721455:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946694.721785:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946694.721817:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.721859:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053180 going to sleep for 11 seconds 00000100:00100000:3.0:1783946694.722257:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522963712 00000100:00100000:3.0:1783946694.722264:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522963712 00000100:00100000:3.0:1783946694.722299:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783946694.722308:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522963712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946694.722524:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522963712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946694.722532:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783946694.723224:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946694.723271:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946694.723327:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.723398:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053180 going to sleep for 11 seconds 00000100:00100000:3.0:1783946694.723434:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522963840 00000100:00100000:3.0:1783946694.723440:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522963840 00000100:00100000:3.0:1783946694.723960:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783946694.723971:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522963840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946694.724134:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522963840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946694.724142:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783946694.724237:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522963840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946694.724868:0:8845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8845:1870603522963968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946694.724921:0:8845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.725396:0:8845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137860533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.725666:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522963968 00000100:00100000:0.0:1783946694.725675:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522963968 00000100:00100000:0.0:1783946694.725717:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783946694.725727:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:8845:x1870603522963968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.725887:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:8845:x1870603522963968:12345-0@lo:502:llog_process_th.0 Request processed in 160us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.725895:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783946694.726258:0:8845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8845:1870603522963968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946694.726324:0:8845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8845:1870603522964096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946694.726367:0:8845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.726398:0:8845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137860533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.726441:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522964096 00000100:00100000:0.0:1783946694.726455:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522964096 00000100:00100000:0.0:1783946694.726488:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783946694.726509:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:8845:x1870603522964096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.726594:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:8845:x1870603522964096:12345-0@lo:502:llog_process_th.0 Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.726602:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783946694.726989:0:8845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8845:1870603522964096:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783946694.727029:0:8845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783946694.727409:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783946694.727436:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783946694.727448:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.727486:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946694.727502:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783946694.727504:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1783946694.727508:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783946694.727540:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.727548:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.727557:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946694.727575:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.727619:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.727654:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:2.0:1783946694.727808:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522964224 00000100:00100000:2.0:1783946694.727815:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522964224 00000100:00100000:2.0:1783946694.727862:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783946694.727881:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:5953:x1870603522964224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946694.727892:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946694.727906:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797623a00/0x229d2ec450db72a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db729a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.727933:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797623a00/0x229d2ec450db72a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db729a expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.727944:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797623a00/0x229d2ec450db72a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db729a expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.727953:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623a00, rc 0) 00000100:00100000:2.0:1783946694.728000:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522964224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946694.728015:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783946694.728730:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946694.728746:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.728756:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946694.728814:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.728882:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.728928:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:3.0:1783946694.729189:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522964352 00000100:00100000:3.0:1783946694.729195:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522964352 00000100:00100000:3.0:1783946694.729233:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783946694.729243:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522964352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946694.729414:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522964352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946694.729423:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783946694.729645:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.729678:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.729727:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.729743:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:3.0:1783946694.729883:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522964480 00000100:00100000:3.0:1783946694.729889:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522964480 00000100:00100000:3.0:1783946694.729912:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783946694.729919:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522964480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.730220:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.730432:0:8846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8846:1870603522964608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946694.745559:0:8846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.745615:0:8846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a5cdd840 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.745663:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522964608 00000100:00100000:0.0:1783946694.745672:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522964608 00000100:00100000:0.0:1783946694.745716:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783946694.745724:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8846:x1870603522964608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.745881:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8846:x1870603522964608:12345-0@lo:502:llog_process_th.0 Request processed in 157us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.745889:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783946694.746160:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522964480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 16238us (16429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946694.746168:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783946694.746405:0:8846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8846:1870603522964608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783946694.746443:0:8846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783946694.746451:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946694.746453:0:8846:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783946694.746458:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783946694.746502:0:8846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8846:1870603522964736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946694.746540:0:8846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946694.746566:0:8846:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786053d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.746601:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522964736 00000100:00100000:0.0:1783946694.746606:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522964736 00000100:00100000:0.0:1783946694.746628:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783946694.746634:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:8846:x1870603522964736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.746708:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:8846:x1870603522964736:12345-0@lo:502:llog_process_th.0 Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.746714:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783946694.747034:0:8846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8846:1870603522964736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783946694.747051:0:8846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783946694.747056:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946694.747092:0:8846:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783946694.747097:0:8846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1783946694.747363:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1783946694.747385:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783946694.747398:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.747422:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946694.747433:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783946694.747435:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff913786178000 from 39 10000000:01000000:0.0:1783946694.747438:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783946694.747481:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.747490:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.747508:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946694.747524:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.747559:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.747588:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54900 going to sleep for 11 seconds 00000100:00100000:2.0:1783946694.747686:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522964864 00000100:00100000:2.0:1783946694.747693:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522964864 00000100:00100000:2.0:1783946694.747737:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783946694.747744:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522964864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946694.747755:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946694.747769:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797622200/0x229d2ec450db72af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db72a8 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.747791:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622200/0x229d2ec450db72af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db72a8 expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.747802:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797622200/0x229d2ec450db72af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db72a8 expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.747811:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622200, rc 0) 00000100:00100000:2.0:1783946694.747861:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522964864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946694.747885:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783946694.748142:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946694.748156:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.748168:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946694.748244:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.748274:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.748305:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54900 going to sleep for 11 seconds 00000100:00100000:1.0:1783946694.748361:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522964992 00000100:00100000:1.0:1783946694.748367:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522964992 00000100:00100000:1.0:1783946694.748398:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783946694.748406:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522964992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783946694.748562:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522964992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946694.748569:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783946694.749288:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522964992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.749342:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522965120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.749384:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.749418:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54900 going to sleep for 11 seconds 00000100:00100000:2.0:1783946694.749628:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522965120 00000100:00100000:2.0:1783946694.749634:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522965120 00000100:00100000:2.0:1783946694.749671:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783946694.749678:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522965120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946694.749762:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522965120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946694.749769:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783946694.750030:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522965120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946694.751385:0:8847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8847:1870603522965248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946694.751471:0:8847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946694.751667:0:8847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be39bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946694.768484:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522965248 00000100:00100000:2.0:1783946694.768503:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522965248 00000100:00100000:2.0:1783946694.768570:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783946694.768581:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8847:x1870603522965248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946694.768802:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8847:x1870603522965248:12345-0@lo:502:llog_process_th.0 Request processed in 222us (17330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946694.768811:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783946694.768967:0:8847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8847:1870603522965248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.769054:0:8847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8847:1870603522965376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.769123:0:8847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.769150:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522965376 00000100:00100000:0.0:1783946694.769155:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522965376 00000100:00100000:0.0:1783946694.769180:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783946694.769187:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8847:x1870603522965376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.769250:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8847:x1870603522965376:12345-0@lo:502:llog_process_th.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.769257:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783946694.769294:0:8847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54900 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.769308:0:8847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8847:1870603522965376:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783946694.769326:0:8847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783946694.769391:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783946694.769416:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783946694.769427:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.769438:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946694.769456:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783946694.769459:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1783946694.769461:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783946694.769486:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.769495:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.769503:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946694.769517:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522965504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.769543:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.769556:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54900 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.769568:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522965504 00000100:00100000:0.0:1783946694.769572:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522965504 00000100:00100000:0.0:1783946694.769589:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783946694.769595:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522965504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946694.769603:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946694.769615:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bf400/0x229d2ec450db72bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db72b6 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.769635:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bf400/0x229d2ec450db72bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db72b6 expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.769646:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bf400/0x229d2ec450db72bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db72b6 expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.769665:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf400, rc 0) 00000100:00100000:0.0:1783946694.769695:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522965504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.769701:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783946694.769725:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522965504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946694.769737:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.769746:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946694.769790:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522965632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.769813:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.769822:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54900 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.769837:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522965632 00000100:00100000:0.0:1783946694.769854:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522965632 00000100:00100000:0.0:1783946694.769872:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783946694.769878:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522965632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.769979:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522965632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.769986:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783946694.770007:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522965632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.770031:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522965760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.770085:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946694.770103:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54900 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.770118:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522965760 00000100:00100000:0.0:1783946694.770121:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522965760 00000100:00100000:0.0:1783946694.770137:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783946694.770142:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522965760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946694.770216:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522965760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.770223:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783946694.770253:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522965760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946694.778365:0:8848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8848:1870603522965888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946694.778504:0:8848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946694.778554:0:8848:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be39bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.778743:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522965888 00000100:00100000:0.0:1783946694.778752:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522965888 00000100:00100000:0.0:1783946694.778808:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783946694.778819:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8848:x1870603522965888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.778969:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8848:x1870603522965888:12345-0@lo:502:llog_process_th.0 Request processed in 151us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.778977:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783946694.779269:0:8848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8848:1870603522965888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783946694.779300:0:8848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783946694.779315:0:8848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946694.779318:0:8848:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783946694.779325:0:8848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783946694.779349:0:8848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8848:1870603522966016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946694.779383:0:8848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946694.779407:0:8848:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be39bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.779507:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522966016 00000100:00100000:0.0:1783946694.779512:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522966016 00000100:00100000:0.0:1783946694.779535:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783946694.779541:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8848:x1870603522966016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946694.779611:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8848:x1870603522966016:12345-0@lo:502:llog_process_th.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.779618:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783946694.780139:0:8848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8848:1870603522966016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783946694.780163:0:8848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783946694.780170:0:8848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946694.780172:0:8848:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783946694.780177:0:8848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1783946694.783630:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1783946694.783678:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783946694.783694:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.783727:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946694.783738:0:5953:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783946694.783740:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9137909d0000 from 1 10000000:01000000:0.0:1783946694.783743:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783946694.783783:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.783790:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.783800:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946694.783827:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522966144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783946694.793211:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946694.793272:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946694.793444:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522966144 00000100:00100000:0.0:1783946694.793466:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522966144 00000100:00100000:0.0:1783946694.793542:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783946694.793554:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522966144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946694.793573:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946694.793596:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35be800/0x229d2ec450db72cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db72c4 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.793630:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35be800/0x229d2ec450db72cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db72c4 expref: 19 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.793642:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35be800/0x229d2ec450db72cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db72c4 expref: 19 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946694.793666:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35be800, rc 0) 00000100:00100000:0.0:1783946694.793720:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522966144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946694.793727:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783946694.793884:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522966144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783946694.793902:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72cb expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946694.793913:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db72cb expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946694.794000:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522966272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783946694.794052:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946694.794109:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9bdaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783946694.794185:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522966272 00000100:00100000:2.0:1783946694.794190:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522966272 00000100:00100000:2.0:1783946694.794223:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783946694.794231:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522966272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946694.794317:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522966272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (264us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783946694.794324:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783946694.794669:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522966272:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783946694.794701:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783946694.794709:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72cb expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946694.794718:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72cb expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946694.802568:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946695.828787:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946696.497324:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946696.497688:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507208960 00000100:00100000:2.0:1783946696.497703:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507208960 00000100:00100000:2.0:1783946696.497786:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:2.0:1783946696.497832:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:5452:x1870603507208960:12345-192.168.201.18@tcp:101: 00010000:00010000:2.0:1783946696.497868:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946696.498160:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797623c00/0x229d2ec450db72d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571db1 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946696.498204:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797623c00/0x229d2ec450db72d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571db1 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946696.498219:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797623c00/0x229d2ec450db72d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571db1 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946696.498231:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623c00, rc 0) 00000100:00100000:2.0:1783946696.498317:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5452:x1870603507208960:12345-192.168.201.18@tcp:101: Request processed in 490us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946696.498326:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:0.0:1783946696.503123:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946696.503272:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507209088 00000100:00100000:2.0:1783946696.503286:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507209088 00000100:00100000:2.0:1783946696.503361:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:2.0:1783946696.503373:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5452:x1870603507209088:12345-192.168.201.18@tcp:501: 00000100:00100000:2.0:1783946696.503778:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5452:x1870603507209088:12345-192.168.201.18@tcp:501: Request processed in 405us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946696.503788:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:0.0:1783946696.516220:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946696.516605:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507209216 00000100:00100000:3.0:1783946696.516619:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507209216 00000100:00100000:3.0:1783946696.516698:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:3.0:1783946696.516712:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5452:x1870603507209216:12345-192.168.201.18@tcp:503: 00000100:00100000:3.0:1783946696.517240:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5452:x1870603507209216:12345-192.168.201.18@tcp:503: Request processed in 347us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946696.517254:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:0.0:1783946696.526051:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946696.530421:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507209344 00000100:00100000:2.0:1783946696.530443:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507209344 00000100:00100000:2.0:1783946696.530560:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:2.0:1783946696.530575:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5938:x1870603507209344:12345-192.168.201.18@tcp:502: 00000100:00100000:2.0:1783946696.530803:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5938:x1870603507209344:12345-192.168.201.18@tcp:502: Request processed in 231us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946696.530830:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:0.0:1783946696.541047:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946696.541962:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507209472 00000100:00100000:2.0:1783946696.541977:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507209472 00000100:00100000:2.0:1783946696.542110:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:2.0:1783946696.542125:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5938:x1870603507209472:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783946696.542380:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5938:x1870603507209472:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 258us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946696.542389:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:0.0:1783946696.548793:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946696.549578:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507209600 00000100:00100000:3.0:1783946696.549592:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507209600 00000100:00100000:3.0:1783946696.549722:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:3.0:1783946696.549736:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5452:x1870603507209600:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783946696.549762:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946696.549787:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91378151ac00/0x229d2ec450db72d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571db8 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946696.550047:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91378151ac00/0x229d2ec450db72d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571db8 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946696.550171:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91378151ac00/0x229d2ec450db72d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571db8 expref: 10 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946696.550184:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151ac00, rc 0) 00000100:00100000:2.0:1783946696.550399:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5452:x1870603507209600:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 662us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946696.550408:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:1.0:1783946696.557985:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946696.558346:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507209728 00000100:00100000:0.0:1783946696.558360:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507209728 00000100:00100000:0.0:1783946696.558451:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:0.0:1783946696.558464:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5452:x1870603507209728:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946696.558648:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5452:x1870603507209728:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 186us (679us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783946696.558659:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:0.0:1783946696.563726:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946696.563785:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946696.563927:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507209984 00000100:00100000:2.0:1783946696.563940:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507209984 00000100:00100000:2.0:1783946696.564044:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1783946696.564082:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507209984:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946696.564189:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507209984:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 134us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946696.564199:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1783946696.564651:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00080000:3.0:1783946696.565615:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946696.565751:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507210112 00000100:00100000:2.0:1783946696.565764:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507210112 00000100:00100000:2.0:1783946696.565870:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:2.0:1783946696.565882:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507210112:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946696.566268:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507210112:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 386us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946696.566300:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00080000:3.0:1783946696.568265:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946696.575410:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507209856 00000100:00100000:1.0:1783946696.575432:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507209856 00000100:00100000:1.0:1783946696.575566:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:1.0:1783946696.575581:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507209856:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946696.575747:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507209856:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 169us (11959us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946696.575755:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00080000:3.0:1783946696.576125:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946696.595784:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783946696.595844:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522966400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946696.595978:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946696.596576:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522966400 00000100:00100000:1.0:1783946696.596588:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522966400 00000100:00100000:1.0:1783946696.596678:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783946696.596690:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522966400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946696.596735:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946696.596806:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522966400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946696.596826:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1783946696.596933:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783946696.597271:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bde8c000 x1870603522966400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946696.597328:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522966400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783946696.848664:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946697.617452:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522966784:0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.617562:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522966528:0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.617679:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946697.617745:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522967040:0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.617774:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946697.617827:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783946697.617834:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522966912:0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.617864:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946697.617900:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522966656:0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.617927:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946697.617946:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522967168:0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.617967:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946697.618005:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522966528 00000100:00100000:1.0:1783946697.618014:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522966528 00000100:00100000:1.0:1783946697.618108:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783946697.618139:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522966528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.618200:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522966528:12345-0@lo:400:kworker.0 Request processed in 63us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946697.618208:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783946697.618245:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522967040 00000100:00100000:1.0:1783946697.618249:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522967040 00000100:00100000:1.0:1783946697.618288:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522966656 00000100:00100000:1.0:1783946697.618292:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522966656 00000100:00100000:1.0:1783946697.618311:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783946697.618318:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522967040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.618353:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522967040:12345-0@lo:400:kworker.0 Request processed in 35us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946697.618360:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783946697.618379:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783946697.618386:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522966656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.618419:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522966656:12345-0@lo:400:kworker.0 Request processed in 34us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946697.618425:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783946697.618443:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522966912 00000100:00100000:1.0:1783946697.618447:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522966912 00000100:00100000:1.0:1783946697.619565:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522967168 00000100:00100000:1.0:1783946697.619576:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522967168 00000100:00100000:1.0:1783946697.619606:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783946697.619616:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522966912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.619688:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522966912:12345-0@lo:400:kworker.0 Request processed in 73us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946697.619695:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783946697.619725:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783946697.619730:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522967168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.619761:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522967168:12345-0@lo:400:kworker.0 Request processed in 31us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946697.619766:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783946697.619867:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522966656:0@lo:400:kworker.0 00010000:00080000:1.0:1783946697.619894:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23ce00 x1870603522967168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946697.619905:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522967168:0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.619930:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783946697.619941:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522967296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946697.619977:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946697.620021:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522967296 00000100:00100000:1.0:1783946697.620026:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522967296 00000100:00100000:1.0:1783946697.620055:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783946697.620088:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522967296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946697.620116:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946697.620156:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522967296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946697.620164:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1783946697.620186:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783946697.620193:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783946697.620211:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdd6d880 x1870603522967296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946697.620229:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522967296:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783946697.620276:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23d880 x1870603522966912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946697.620286:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522966912:0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.620307:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522966528:0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.620321:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522967040:0@lo:400:kworker.0 00000100:00100000:3.0:1783946697.620462:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946697.624085:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522966784 00000100:00100000:1.0:1783946697.624107:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522966784 00000100:00100000:1.0:1783946697.624202:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783946697.624214:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522966784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946697.624336:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522966784:12345-0@lo:400:kworker.0 Request processed in 123us (3873us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946697.624345:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1783946697.624566:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946697.624677:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522966784:0@lo:400:kworker.0 00010000:00010000:1.0:1783946697.873088:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783946698.556898:0:8885:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff520356b0 20000000:00000080:2.0:1783946698.556917:0:8885:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9137bdc82400 uarg=0000000000000000 20000000:01000000:2.0:1783946698.556964:0:8885:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783946698.556971:0:8885:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783946698.556976:0:8885:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783946698.560759:0:8886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1783946698.562254:0:8885:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1783946698.572047:0:8885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1783946698.572254:0:8885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1783946698.572270:0:8885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1783946698.572286:0:8885:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783946698.572306:0:8885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.572324:0:8885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913780030800/0x229d2ec450db7055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db704e expref: 18 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.572332:0:8885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db70b0 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.572339:0:8885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db717b expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.572350:0:8885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d80 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.572357:0:8885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.572606:0:8885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d80 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.572625:0:8885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d80 expref: 9 pid: 5949 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946698.572643:0:8885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8885:1870603522967424:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946698.572826:0:8885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db717b expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.572835:0:8885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db717b expref: 18 pid: 5951 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946698.572844:0:8885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8885:1870603522967552:0@lo:104: 00000100:00100000:2.0:1783946698.572886:0:8885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783946698.572923:0:8885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db70b0 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.572930:0:8885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db70b0 expref: 18 pid: 5949 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946698.572938:0:8885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8885:1870603522967680:0@lo:104: 00000100:00100000:2.0:1783946698.572960:0:8885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946698.572995:0:5939:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783946698.573007:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522967552 00000100:00100000:2.0:1783946698.573015:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522967552 00000100:00100000:2.0:1783946698.573054:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522967680 00000100:00100000:2.0:1783946698.573057:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522967680 00000100:00100000:2.0:1783946698.573113:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783946698.573121:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:8885:x1870603522967552:12345-0@lo:104: 00010000:00010000:2.0:1783946698.573134:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573178:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783946698.573184:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:8885:x1870603522967552:12345-0@lo:104: Request processed in 64us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946698.573192:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783946698.573209:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783946698.573215:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:8885:x1870603522967680:12345-0@lo:104: 00010000:00010000:2.0:1783946698.573222:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573253:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783946698.573257:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:8885:x1870603522967680:12345-0@lo:104: Request processed in 43us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946698.573262:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1783946698.573293:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783946698.573298:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573305:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946698.573309:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573317:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946698.573334:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946698.573340:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783946698.573369:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573375:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946698.573409:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573640:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797623000/0x229d2ec450db717b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7182 expref: -99 pid: 8013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573654:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946698.573658:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573664:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137c21d4400 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946698.573667:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573673:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946698.573680:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946698.573685:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783946698.573707:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573713:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946698.573720:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573727:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137c21d4400/0x229d2ec450db70b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db70b7 expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.573738:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946698.573739:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946698.573741:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946698.573757:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522967808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783946698.574962:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946698.575027:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946698.575037:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522967936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783946698.575096:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946698.575138:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522967808 00000100:00100000:2.0:1783946698.575145:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522967808 00010000:00010000:2.0:1783946698.575178:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db717b expref: 19 pid: 5951 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946698.575209:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522967936 00000100:00100000:2.0:1783946698.575211:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522967936 00010000:00010000:2.0:1783946698.575222:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db70b0 expref: 20 pid: 5949 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946698.575241:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783946698.575249:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+20:3447:x1870603522967808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783946698.575278:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946698.575283:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db717b expref: 20 pid: 5951 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.575292:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db717b expref: 20 pid: 5951 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.575311:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946698.575344:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+20:3447:x1870603522967808:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946698.575351:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783946698.575369:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783946698.575375:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522967936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783946698.575395:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946698.575399:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db70b0 expref: 19 pid: 5949 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.575409:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db70b0 expref: 19 pid: 5949 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.576734:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783946698.578189:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946698.578403:0:8885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913780030800/0x229d2ec450db7055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db704e expref: 19 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946698.578426:0:8885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff913780030800/0x229d2ec450db7055 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db704e expref: 19 pid: 5950 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946698.578442:0:8885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8885:1870603522968064:0@lo:104: 00000100:00100000:0.0:1783946698.578515:0:8885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946698.578543:0:8885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8ba80 going to sleep for 11 seconds 00010000:00010000:0.0:1783946698.578569:0:8885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f44c00/0x229d2ec450db7182 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db717b expref: 19 pid: 5951 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946698.578581:0:8885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8885:1870603522967552:0@lo:104: 00010000:00010000:0.0:1783946698.578593:0:8885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137c21d5e00/0x229d2ec450db70b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db70b0 expref: 18 pid: 5949 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946698.578604:0:8885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8885:1870603522967680:0@lo:104: 00000100:00100000:2.0:1783946698.582940:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522967936:12345-0@lo:103:ldlm_bl.0 Request processed in 1425us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946698.582973:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783946698.583111:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522967936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783946698.583124:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522967808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783946698.583166:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522968064 00000100:00100000:2.0:1783946698.583197:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522968064 00000100:00100000:2.0:1783946698.583265:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783946698.583276:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:8885:x1870603522968064:12345-0@lo:104: 00010000:00010000:2.0:1783946698.583295:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.583395:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783946698.583401:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:8885:x1870603522968064:12345-0@lo:104: Request processed in 127us (4886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946698.583407:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1783946698.583437:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946698.583444:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.583451:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151b000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946698.583456:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.583465:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946698.583472:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946698.583488:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783946698.583534:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.583540:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946698.583564:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.583578:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db704e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db7055 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.583596:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946698.583598:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946698.583599:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946698.583615:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522968192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783946698.583656:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946698.583700:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522968192 00000100:00100000:2.0:1783946698.583704:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522968192 00010000:00010000:2.0:1783946698.583724:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913780030800/0x229d2ec450db7055 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db704e expref: 17 pid: 5950 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946698.583748:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783946698.583754:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:3449:x1870603522968192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783946698.583766:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946698.583772:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913780030800/0x229d2ec450db7055 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db704e expref: 17 pid: 5950 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.583795:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913780030800/0x229d2ec450db7055 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db704e expref: 17 pid: 5950 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.583948:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946698.583980:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:3449:x1870603522968192:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946698.583988:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783946698.584017:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522968192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783946698.584614:0:8885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913780030800/0x229d2ec450db7055 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db704e expref: 16 pid: 5950 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946698.584626:0:8885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8885:1870603522968064:0@lo:104: 00000100:00100000:3.0:1783946698.587307:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946698.587342:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507210240 00000100:00100000:3.0:1783946698.587351:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507210240 00010000:00010000:3.0:1783946698.587402:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d80 expref: 10 pid: 5949 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946698.587974:0:8885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8885:1870603522967424:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946698.588015:0:8885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946698.594329:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:2.0:1783946698.594356:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2361:x1870603507210240:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946698.594377:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946698.594399:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d80 expref: 10 pid: 5949 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594623:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d80 expref: 10 pid: 5949 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594646:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bf800/0x229d2ec450db723f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571d80 expref: 10 pid: 5949 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594666:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594675:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594695:0:8023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594703:0:8023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594710:0:8023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594717:0:8023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594741:0:8023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946698.594746:0:8023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.594753:0:8023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946698.595358:0:8885:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946698.595375:0:8885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.597647:0:8023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.597670:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622000/0x229d2ec450db72e0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946698.597694:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946698.597798:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:2361:x1870603507210240:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 3450us (10495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946698.597815:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00010000:00010000:1.0:1783946698.900546:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946699.920577:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783946700.304377:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783946700.304387:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137a7c0f800 from 4 10000000:01000000:2.0:1783946700.304392:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783946700.304446:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946700.304461:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946700.304474:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946700.304516:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522968320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783946700.304600:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946700.304757:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783946700.311326:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522968320 00000100:00100000:0.0:1783946700.311344:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522968320 00000100:00100000:0.0:1783946700.311754:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783946700.311766:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522968320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946700.311784:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946700.311804:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db72e7 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.311830:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db72e7 expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.311838:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db72e7 expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.311845:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35be000, rc 0) 00000100:00100000:0.0:1783946700.312634:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522968320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 867us (8033us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946700.312643:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783946700.312673:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522968320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946700.312698:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946700.312708:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946700.312810:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522968448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946700.312851:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946700.316018:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783946700.316248:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522968448 00000100:00100000:0.0:1783946700.316265:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522968448 00000100:00100000:0.0:1783946700.316324:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783946700.316334:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522968448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946700.316525:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522968448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (3673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946700.316549:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783946700.316568:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522968448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946700.316626:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522968576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946700.316675:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946700.316709:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be39b240 going to sleep for 11 seconds 00000100:00100000:0.0:1783946700.327461:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522968576 00000100:00100000:0.0:1783946700.327478:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522968576 00000100:00100000:0.0:1783946700.327536:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783946700.327547:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522968576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946700.327712:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522968576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (11036us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946700.327719:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783946700.327794:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522968576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946700.328048:0:8943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8943:1870603522968704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946700.328123:0:8943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946700.328159:0:8943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4a00480 going to sleep for 11 seconds 00000100:00100000:2.0:1783946700.330486:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522968704 00000100:00100000:2.0:1783946700.330503:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522968704 00000100:00100000:3.0:1783946700.330812:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783946700.330831:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8943:x1870603522968704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946700.331006:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8943:x1870603522968704:12345-0@lo:502:llog_process_th.0 Request processed in 177us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946700.331015:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1783946700.331137:0:8943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8943:1870603522968704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783946700.331173:0:8943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946700.331185:0:8943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946700.331187:0:8943:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783946700.331196:0:8943:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9137a7c0f800 00000020:00000080:0.0:1783946700.331198:0:8943:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783946700.331294:0:8943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8943:1870603522968832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946700.331341:0:8943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946700.331369:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522968832 00000100:00100000:0.0:1783946700.331374:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522968832 00000100:00100000:0.0:1783946700.331397:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783946700.331403:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8943:x1870603522968832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946700.331471:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:8943:x1870603522968832:12345-0@lo:502:llog_process_th.0 Request processed in 68us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946700.331484:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783946700.331523:0:8943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4a00480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946700.331535:0:8943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8943:1870603522968832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783946700.331552:0:8943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946700.331557:0:8943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946700.331558:0:8943:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783946700.331561:0:8943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783946700.331629:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783946700.331658:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783946700.331668:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.331678:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946700.331688:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783946700.331691:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137b63de800 from 4 10000000:01000000:0.0:1783946700.331694:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783946700.331717:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.331726:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.331735:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946700.331760:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522968960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783946700.331787:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946700.331809:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4a00480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946700.331821:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522968960 00000100:00100000:0.0:1783946700.331824:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522968960 00000100:00100000:0.0:1783946700.331842:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783946700.331847:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522968960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946700.331855:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946700.331868:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db72f5 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.331890:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db72f5 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.331901:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db72f5 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.331910:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bfe00, rc 0) 00000100:00100000:0.0:1783946700.331939:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522968960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946700.331944:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783946700.331973:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522968960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946700.331985:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946700.331994:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946700.332041:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946700.332097:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946700.332118:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4a00480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946700.332129:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522969088 00000100:00100000:0.0:1783946700.332132:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522969088 00000100:00100000:0.0:1783946700.332148:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783946700.332154:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522969088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946700.332243:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522969088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946700.332250:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783946700.332275:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946700.332299:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946700.332331:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946700.332344:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4a00480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946700.332356:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522969216 00000100:00100000:0.0:1783946700.332359:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522969216 00000100:00100000:0.0:1783946700.332374:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783946700.332379:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522969216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946700.332438:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522969216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946700.332444:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783946700.332476:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946700.337734:0:8944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8944:1870603522969344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946700.338567:0:8944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946700.338613:0:8944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b240 going to sleep for 11 seconds 00000100:00100000:0.0:1783946700.338861:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522969344 00000100:00100000:0.0:1783946700.338868:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522969344 00000100:00100000:0.0:1783946700.338927:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783946700.338938:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8944:x1870603522969344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946700.339095:0:8944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8944:1870603522969344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783946700.339124:0:8944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1783946700.339667:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8944:x1870603522969344:12345-0@lo:502:llog_process_th.0 Request processed in 729us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946700.339686:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000020:00000080:2.0:1783946700.339816:0:8944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946700.339820:0:8944:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783946700.339828:0:8944:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9137b63de800 00000020:00000080:2.0:1783946700.339831:0:8944:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783946700.342243:0:8944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8944:1870603522969472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946700.342394:0:8944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946700.343110:0:8944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783946700.343346:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522969472 00000100:00100000:3.0:1783946700.343356:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522969472 00000100:00100000:3.0:1783946700.344030:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1783946700.344047:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8944:x1870603522969472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946700.345023:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:8944:x1870603522969472:12345-0@lo:502:llog_process_th.0 Request processed in 976us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946700.345035:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783946700.347999:0:8944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8944:1870603522969472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783946700.348045:0:8944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946700.348055:0:8944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946700.348070:0:8944:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783946700.348075:0:8944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783946700.349135:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783946700.349169:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783946700.349183:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946700.349214:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946700.349227:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783946700.349230:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff913786178000 from 4 10000000:01000000:1.0:1783946700.349233:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783946700.349280:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946700.349288:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946700.349299:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946700.349326:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783946700.349402:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946700.349449:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9bda300 going to sleep for 11 seconds 00000100:00100000:1.0:1783946700.349472:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522969600 00000100:00100000:1.0:1783946700.349478:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522969600 00000100:00100000:1.0:1783946700.351660:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783946700.351680:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522969600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783946700.351701:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946700.351720:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7303 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946700.351763:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7303 expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946700.353087:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7303 expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946700.353104:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44800, rc 0) 00000100:00100000:1.0:1783946700.353210:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522969600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1537us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946700.353220:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783946700.359560:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946700.359602:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946700.359617:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946700.359722:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946700.359795:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946700.359846:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b480 going to sleep for 11 seconds 00000100:00100000:1.0:1783946700.360661:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522969728 00000100:00100000:1.0:1783946700.360670:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522969728 00000100:00100000:1.0:1783946700.360716:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783946700.360725:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522969728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783946700.360870:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522969728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946700.360878:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783946700.361054:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946700.361114:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946700.361378:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946700.361723:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522969856 00000100:00100000:1.0:1783946700.361730:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522969856 00000100:00100000:1.0:1783946700.361774:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783946700.361782:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522969856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783946700.361885:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522969856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946700.361892:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1783946700.362030:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783946700.362046:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522969856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946700.365327:0:8947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8947:1870603522969984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946700.365422:0:8947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946700.365461:0:8947:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783946700.368607:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522969984 00000100:00100000:1.0:1783946700.368632:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522969984 00000100:00100000:1.0:1783946700.368703:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783946700.368714:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:8947:x1870603522969984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783946700.372012:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:8947:x1870603522969984:12345-0@lo:502:llog_process_th.0 Request processed in 3292us (6582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946700.372025:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1783946700.384469:0:8947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8947:1870603522969984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783946700.384517:0:8947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783946700.384528:0:8947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946700.384530:0:8947:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783946700.384538:0:8947:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff913786178000 00000020:00000080:2.0:1783946700.384541:0:8947:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783946700.398819:0:8947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8947:1870603522970112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946700.399343:0:8947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946700.399793:0:8947:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f8b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783946700.400679:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522970112 00000100:00100000:1.0:1783946700.400694:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522970112 00000100:00100000:1.0:1783946700.400765:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1783946700.400777:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:8947:x1870603522970112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783946700.400970:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:8947:x1870603522970112:12345-0@lo:502:llog_process_th.0 Request processed in 194us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946700.400980:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783946700.401228:0:8947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:8947:1870603522970112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783946700.401272:0:8947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783946700.401281:0:8947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946700.401283:0:8947:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783946700.401289:0:8947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783946700.401357:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783946700.401376:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783946700.401386:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946700.401397:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946700.599500:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946700.599575:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507210368 00000100:00100000:2.0:1783946700.599584:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507210368 00000100:00100000:2.0:1783946700.599638:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 190 00000100:00100000:2.0:1783946700.599648:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:5452:x1870603507210368:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946700.599664:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946700.599682:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571dbf expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946700.599708:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571dbf expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946700.599719:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571dbf expref: 10 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946700.599751:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623400, rc 0) 00000100:00100000:2.0:1783946700.599809:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5452:x1870603507210368:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 162us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946700.599816:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 190 00000100:00100000:1.0:1783946700.606881:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946700.607534:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507210496 00000100:00100000:3.0:1783946700.607545:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507210496 00000100:00100000:3.0:1783946700.607602:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00100000:3.0:1783946700.607612:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5452:x1870603507210496:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946700.607793:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5452:x1870603507210496:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 182us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946700.607801:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00100000:1.0:1783946700.642155:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946700.642192:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507210624 00000100:00100000:1.0:1783946700.642203:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507210624 00000100:00100000:1.0:1783946700.642254:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 192 00000100:00100000:1.0:1783946700.642263:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5452:x1870603507210624:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783946700.642400:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:5452:x1870603507210624:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 137us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946700.642409:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 192 00000100:00100000:1.0:1783946700.650911:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946700.651316:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507210752 00000100:00100000:2.0:1783946700.651328:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507210752 00000100:00100000:2.0:1783946700.651645:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:2.0:1783946700.651658:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:6001:x1870603507210752:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783946700.651840:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:6001:x1870603507210752:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 183us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946700.651848:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:1.0:1783946700.665851:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946700.666276:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507210880 00000100:00100000:0.0:1783946700.666289:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507210880 00000100:00100000:0.0:1783946700.666348:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 194 00000100:00100000:0.0:1783946700.666360:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:6001:x1870603507210880:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783946700.666613:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:6001:x1870603507210880:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 254us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946700.666623:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 194 00010000:00010000:0.0:1783946700.947181:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946701.680671:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946701.680746:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946701.680778:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946701.680813:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946701.680864:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507211008 00000100:00100000:1.0:1783946701.680866:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507211392 00000100:00100000:1.0:1783946701.680874:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507211392 00000100:00100000:3.0:1783946701.680881:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507211008 00000100:00100000:1.0:1783946701.680919:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507211264 00000100:00100000:1.0:1783946701.680922:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507211264 00000100:00100000:3.0:1783946701.680924:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:3.0:1783946701.680933:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2364:x1870603507211008:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946701.680936:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1783946701.680942:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507211392:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946701.681029:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507211136 00000100:00100000:0.0:1783946701.681030:0:6944:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783946701.681034:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507211136 00000100:00100000:0.0:1783946701.681038:0:6944:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1783946701.681091:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1783946701.681125:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507211392:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946701.681134:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1783946701.681151:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1783946701.681158:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507211264:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946701.681213:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507211136:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946701.683614:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2364:x1870603507211008:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 2669us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946701.683628:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00080000:3.0:1783946701.683735:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783946701.683742:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783946701.683745:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946701.686614:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507211264:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 5443us (5786us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946701.686629:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1783946701.687650:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507211136:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 6433us (6983us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946701.687661:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:2.0:1783946701.712776:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522970240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946701.712880:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946701.713147:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522970240 00000100:00100000:0.0:1783946701.713157:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522970240 00000100:00100000:0.0:1783946701.713245:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783946701.713257:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522970240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946701.713290:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:3.0:1783946701.713615:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783946701.719487:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522970240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6219us (6593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946701.719504:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1783946701.721213:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bde8c700 x1870603522970240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946701.725602:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522970240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783946701.968407:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946702.736432:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522970368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946702.736508:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946702.736674:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522970368 00000100:00100000:2.0:1783946702.736684:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522970368 00000100:00100000:2.0:1783946702.736778:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783946702.736789:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522970368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783946702.736819:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946702.736876:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522970368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (366us total) trans 0 rc 0/0 00010000:00080000:1.0:1783946702.737195:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdd6f100 x1870603522970368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946702.737215:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522970368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946702.737343:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1783946702.737437:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783946702.737648:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522970880:0@lo:400:kworker.0 00000100:00100000:0.0:1783946702.737693:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946702.737735:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783946702.737741:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522970496:0@lo:400:kworker.0 00000100:00100000:0.0:1783946702.737784:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946702.737804:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522971008:0@lo:400:kworker.0 00000100:00100000:0.0:1783946702.737828:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946702.738251:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522970624:0@lo:400:kworker.0 00000100:00100000:3.0:1783946702.738281:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946702.738301:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946702.738307:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522970752:0@lo:400:kworker.0 00000100:00100000:3.0:1783946702.738327:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946702.738355:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522971008 00000100:00100000:3.0:1783946702.738361:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522971008 00000100:00100000:3.0:1783946702.738402:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522970624 00000100:00100000:3.0:1783946702.738405:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522970624 00000100:00100000:3.0:1783946702.738417:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522970752 00000100:00100000:3.0:1783946702.738419:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522970752 00000100:00100000:3.0:1783946702.738434:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783946702.738442:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522971008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946702.738488:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522971008:12345-0@lo:400:kworker.0 Request processed in 46us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946702.738494:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783946702.738508:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783946702.738515:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522970624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946702.738545:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522970624:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946702.738551:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783946702.738561:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783946702.738566:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522970752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946702.738604:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522970752:12345-0@lo:400:kworker.0 Request processed in 38us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946702.738611:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1783946702.738626:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946702.738648:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522970752:0@lo:400:kworker.0 00000100:00100000:3.0:1783946702.738657:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522970624:0@lo:400:kworker.0 00000100:00100000:0.0:1783946702.738752:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522971008:0@lo:400:kworker.0 00000100:00100000:1.0:1783946702.739112:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522970880 00000100:00100000:1.0:1783946702.739118:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522970880 00000100:00100000:0.0:1783946702.739272:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522970496 00000100:00100000:0.0:1783946702.739276:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522970496 00000100:00100000:0.0:1783946702.739318:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1783946702.739325:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522970496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946702.739373:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522970496:12345-0@lo:400:kworker.0 Request processed in 49us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946702.739380:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1783946702.739415:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522970496:0@lo:400:kworker.0 00000100:00100000:1.0:1783946702.739514:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783946702.739583:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522970880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946702.739631:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522970880:12345-0@lo:400:kworker.0 Request processed in 109us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946702.739638:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1783946702.739723:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653e680 x1870603522970880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946702.739734:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522970880:0@lo:400:kworker.0 00010000:00010000:0.0:1783946702.992415:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946704.017299:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946705.040220:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946706.064977:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783946706.340426:0:9184:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1783946706.807396:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946706.807442:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946706.807582:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507211520 00000100:00100000:3.0:1783946706.807594:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507211520 00000100:00100000:3.0:1783946706.807664:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:3.0:1783946706.807676:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507211520:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946706.807759:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507211520:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 85us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946706.807766:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:1.0:1783946706.811257:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507211648 00000100:00100000:1.0:1783946706.811277:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507211648 00000100:00100000:1.0:1783946706.811394:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:1.0:1783946706.811408:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507211648:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946706.811519:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507211648:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 115us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946706.811526:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00080000:3.0:1783946706.811572:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946706.812218:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946706.812252:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946706.812375:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507211776 00000100:00100000:3.0:1783946706.812386:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507211776 00000100:00100000:1.0:1783946706.812427:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507211904 00000100:00100000:1.0:1783946706.812437:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507211904 00000100:00080000:0.0:1783946706.812509:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783946706.812515:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946706.812629:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1783946706.812651:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2360:x1870603507211776:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:3.0:1783946706.812704:0:9002:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7254 00000100:00080000:3.0:1783946706.812717:0:9002:0:(import.c:65:import_set_state_nolock()) ffff9137a7ee8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783946706.812784:0:9002:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783946706.812986:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+2:2360:x1870603507211776:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 338us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946706.812995:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1783946706.813012:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1783946706.813026:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2360:x1870603507211904:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:3.0:1783946706.813042:0:9002:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db724d 00000100:00080000:3.0:1783946706.813049:0:9002:0:(import.c:65:import_set_state_nolock()) ffff9137bdc7f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783946706.813108:0:9002:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783946706.813188:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+2:2360:x1870603507211904:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 162us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946706.813195:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00010000:00010000:0.0:1783946706.813255:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946706.822107:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946706.836310:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783946706.836346:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522971136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946706.836515:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946706.836583:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522971136 00000100:00100000:1.0:1783946706.836596:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522971136 00000100:00100000:1.0:1783946706.836694:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783946706.836706:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522971136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946706.836747:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946706.836847:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522971136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946706.836855:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1783946706.836888:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653e680 x1870603522971136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946706.836916:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522971136:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783946706.836999:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783946707.088607:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946707.860095:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522971264:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860177:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946707.860226:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522971776:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860265:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946707.860295:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783946707.860302:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522971648:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860327:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946707.860358:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522971392:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860382:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946707.860414:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522971904:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860449:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946707.860469:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946707.860474:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522971520:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860493:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946707.860527:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522971264 00000100:00100000:1.0:1783946707.860535:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522971264 00000100:00100000:1.0:1783946707.860582:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1783946707.860590:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522971264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860653:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522971264:12345-0@lo:400:kworker.0 Request processed in 63us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946707.860660:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1783946707.860692:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522971776 00000100:00100000:1.0:1783946707.860696:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522971776 00000100:00100000:1.0:1783946707.860729:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522971392 00000100:00100000:1.0:1783946707.860732:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522971392 00000100:00100000:1.0:1783946707.860743:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522971520 00000100:00100000:1.0:1783946707.860746:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522971520 00000100:00100000:1.0:1783946707.860759:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783946707.860765:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522971776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860797:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522971776:12345-0@lo:400:kworker.0 Request processed in 32us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946707.860803:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783946707.860815:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783946707.860821:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522971392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860852:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522971392:12345-0@lo:400:kworker.0 Request processed in 30us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946707.860857:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783946707.860876:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783946707.860881:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522971520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.860907:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522971520:12345-0@lo:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946707.860913:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783946707.860930:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522971648 00000100:00100000:1.0:1783946707.860933:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522971648 00000100:00100000:1.0:1783946707.860969:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522971904 00000100:00100000:1.0:1783946707.860972:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522971904 00000100:00100000:1.0:1783946707.860996:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783946707.861002:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522971648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.861033:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522971648:12345-0@lo:400:kworker.0 Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946707.861039:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783946707.861051:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783946707.861055:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522971904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.861105:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522971904:12345-0@lo:400:kworker.0 Request processed in 49us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946707.861111:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1783946707.861142:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783946707.861147:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946707.861190:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522971520:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.861202:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522971392:0@lo:400:kworker.0 00010000:00080000:1.0:1783946707.861213:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be486d80 x1870603522971904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946707.861223:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522971904:0@lo:400:kworker.0 00010000:00080000:1.0:1783946707.861265:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653e300 x1870603522971648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946707.861274:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522971648:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.861282:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522971264:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.861291:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522971776:0@lo:400:kworker.0 00000100:00100000:1.0:1783946707.866385:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522972032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946707.866466:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946707.866668:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522972032 00000100:00100000:3.0:1783946707.866678:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522972032 00000100:00100000:3.0:1783946707.866738:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783946707.866747:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522972032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783946707.866779:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946707.866830:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522972032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946707.866838:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1783946707.866890:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23d180 x1870603522972032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946707.866910:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522972032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783946708.112306:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946709.136554:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946710.161132:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946711.185170:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946711.921154:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946711.921210:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946711.921211:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507212032 00000100:00100000:3.0:1783946711.921221:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507212032 00000100:00100000:1.0:1783946711.921239:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507212160 00000100:00100000:1.0:1783946711.921244:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507212160 00000100:00100000:3.0:1783946711.921279:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:3.0:1783946711.921290:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507212032:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946711.921299:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1783946711.921311:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507212160:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946711.921390:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507212160:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 81us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946711.921397:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00080000:1.0:1783946711.921423:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946711.921498:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507212032:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 209us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946711.921506:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:1.0:1783946711.953246:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783946711.953274:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522972160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946711.953351:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946711.953428:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522972160 00000100:00100000:1.0:1783946711.953435:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522972160 00000100:00100000:1.0:1783946711.953494:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783946711.953503:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522972160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946711.953543:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946711.953601:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522972160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946711.953609:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1783946711.953633:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783946711.953661:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be484380 x1870603522972160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946711.953680:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522972160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783946712.211401:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783946712.791026:0:9428:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing yml_node 00000100:00100000:2.0:1783946712.978685:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522972672:0@lo:400:kworker.0 00000100:00100000:2.0:1783946712.978777:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946712.978856:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783946712.978863:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522972288:0@lo:400:kworker.0 00000100:00100000:2.0:1783946712.978904:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946712.978933:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522972800:0@lo:400:kworker.0 00000100:00100000:2.0:1783946712.978959:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946712.979100:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522972544:0@lo:400:kworker.0 00000100:00100000:3.0:1783946712.979133:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946712.979150:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783946712.979155:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522972416:0@lo:400:kworker.0 00000100:00100000:3.0:1783946712.979177:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946712.979193:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522972928:0@lo:400:kworker.0 00000100:00100000:3.0:1783946712.979214:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946712.979688:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522972672 00000100:00100000:1.0:1783946712.979698:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522972672 00000100:00100000:1.0:1783946712.979757:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522972928 00000100:00100000:1.0:1783946712.979761:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522972928 00000100:00100000:1.0:1783946712.979799:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783946712.979809:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522972672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946712.979873:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522972672:12345-0@lo:400:kworker.0 Request processed in 66us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946712.979881:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783946712.979897:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783946712.979904:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522972928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946712.979936:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522972928:12345-0@lo:400:kworker.0 Request processed in 33us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946712.979943:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783946712.979962:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522972288 00000100:00100000:1.0:1783946712.979966:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522972288 00000100:00100000:1.0:1783946712.979990:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783946712.979997:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522972288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946712.980039:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522972288:12345-0@lo:400:kworker.0 Request processed in 43us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946712.980045:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783946712.980100:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522972800 00000100:00100000:1.0:1783946712.980104:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522972800 00000100:00100000:1.0:1783946712.980128:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522972544 00000100:00100000:1.0:1783946712.980131:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522972544 00000100:00100000:1.0:1783946712.980142:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522972416 00000100:00100000:1.0:1783946712.980145:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522972416 00000100:00100000:1.0:1783946712.980157:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783946712.980162:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522972800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946712.980205:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522972800:12345-0@lo:400:kworker.0 Request processed in 41us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946712.980213:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783946712.980224:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783946712.980229:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522972544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946712.980257:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522972544:12345-0@lo:400:kworker.0 Request processed in 28us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946712.980262:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783946712.980272:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1783946712.980987:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783946712.980994:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946712.981852:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522972416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946712.981934:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522972416:12345-0@lo:400:kworker.0 Request processed in 1654us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946712.981943:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783946712.981977:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946712.981991:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522973056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946712.982037:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946712.982099:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522973056 00000100:00100000:1.0:1783946712.982106:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522973056 00000100:00100000:1.0:1783946712.982144:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783946712.982153:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522973056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946712.982176:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946712.982212:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522973056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946712.982217:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1783946712.982253:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be56d880 x1870603522973056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946712.982273:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522973056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946712.982305:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522972416:0@lo:400:kworker.0 00010000:00080000:1.0:1783946712.982316:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdd6f480 x1870603522972928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946712.982325:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522972928:0@lo:400:kworker.0 00000100:00100000:1.0:1783946712.982336:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522972544:0@lo:400:kworker.0 00000100:00100000:1.0:1783946712.982365:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522972288:0@lo:400:kworker.0 00000100:00100000:1.0:1783946712.982378:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522972800:0@lo:400:kworker.0 00010000:00080000:1.0:1783946712.982391:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdd6d880 x1870603522972672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946712.982400:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522972672:0@lo:400:kworker.0 00000001:00100000:1.0:1783946713.004841:0:8015:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:1.0:1783946713.004851:0:8015:0:(genops.c:906:class_export_put()) final put ffff9137bdc78800/c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:3.0:1783946713.005056:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9137bdc78800/c2268401-da9f-4e1e-8a1c-9473caf67cba for lustre-OST0001 00000020:00000080:3.0:1783946713.005116:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137bdc7f800 for lustre-OST0001 00000001:00100000:3.0:1783946713.005248:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:3.0:1783946713.005251:0:6938:0:(genops.c:906:class_export_put()) final put ffff9137a7eef800/c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:1.0:1783946713.005287:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a7eef800/c2268401-da9f-4e1e-8a1c-9473caf67cba for lustre-OST0000 00000020:00000080:1.0:1783946713.005315:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137a7ee8000 for lustre-OST0000 00010000:00010000:1.0:1783946713.243022:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946714.256736:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946715.280404:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946716.304418:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946717.043828:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946717.043869:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946717.044049:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507212288 00000100:00100000:3.0:1783946717.044080:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507212288 00000100:00100000:3.0:1783946717.044156:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:3.0:1783946717.044168:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507212288:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946717.044249:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507212288:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 83us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946717.044257:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:0.0:1783946717.044615:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507212416 00000100:00100000:0.0:1783946717.044621:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507212416 00000100:00100000:0.0:1783946717.044673:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:0.0:1783946717.044682:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507212416:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946717.044725:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507212416:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 44us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946717.044733:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00080000:3.0:1783946717.045653:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946717.073195:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522973184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946717.073286:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946717.073384:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522973184 00000100:00100000:1.0:1783946717.073393:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522973184 00000100:00100000:1.0:1783946717.073472:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783946717.073482:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522973184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946717.073913:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946717.074046:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522973184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 563us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946717.074055:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1783946717.074101:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783946717.074135:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be487480 x1870603522973184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946717.074154:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522973184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783946717.329303:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783946717.824611:0:9612:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00000100:00100000:1.0:1783946718.096889:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522973312:0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097007:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946718.097139:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522973824:0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097170:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946718.097223:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783946718.097230:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522973696:0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097258:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946718.097293:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522973440:0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097319:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946718.097338:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522973952:0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097358:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946718.097379:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946718.097385:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522973568:0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097406:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946718.097508:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522973824 00000100:00100000:1.0:1783946718.097517:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522973824 00000100:00100000:1.0:1783946718.097586:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522973440 00000100:00100000:1.0:1783946718.097589:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522973440 00000100:00100000:1.0:1783946718.097602:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522973568 00000100:00100000:1.0:1783946718.097605:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522973568 00000100:00100000:1.0:1783946718.097624:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783946718.097634:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522973824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097699:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522973824:12345-0@lo:400:kworker.0 Request processed in 66us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946718.097708:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783946718.097727:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783946718.097733:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522973440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097761:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522973440:12345-0@lo:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946718.097768:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783946718.097778:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783946718.097794:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522973568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097823:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522973568:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946718.097829:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783946718.097850:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522973696 00000100:00100000:1.0:1783946718.097854:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522973696 00000100:00100000:1.0:1783946718.097881:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522973952 00000100:00100000:1.0:1783946718.097883:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522973952 00000100:00100000:1.0:1783946718.097904:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783946718.097910:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522973696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097943:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522973696:12345-0@lo:400:kworker.0 Request processed in 33us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946718.097950:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783946718.097961:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783946718.097966:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522973952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.097992:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522973952:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946718.097998:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1783946718.098027:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783946718.098033:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946718.098056:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522974080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946718.098110:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946718.098145:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522974080 00000100:00100000:1.0:1783946718.098148:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522974080 00000100:00100000:1.0:1783946718.098174:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783946718.098181:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522974080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946718.098210:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946718.098255:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522974080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946718.098263:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1783946718.098306:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be487b80 x1870603522974080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946718.098329:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522974080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946718.098364:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522973568:0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.098376:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522973440:0@lo:400:kworker.0 00010000:00080000:1.0:1783946718.098386:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be56f100 x1870603522973952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946718.098397:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522973952:0@lo:400:kworker.0 00010000:00080000:1.0:1783946718.098658:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be56d500 x1870603522973696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946718.098670:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522973696:0@lo:400:kworker.0 00000100:00100000:1.0:1783946718.098683:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522973824:0@lo:400:kworker.0 00000100:00100000:2.0:1783946718.098805:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522973312 00000100:00100000:2.0:1783946718.098812:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522973312 00000100:00100000:2.0:1783946718.098866:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783946718.098875:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522973312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946718.098931:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522973312:12345-0@lo:400:kworker.0 Request processed in 58us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946718.098939:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783946718.098985:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522973312:0@lo:400:kworker.0 00010000:00010000:3.0:1783946718.353275:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946719.376368:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946720.400373:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783946721.355701:0:9709:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:3.0:1783946721.431610:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946722.161742:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946722.161815:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946722.161856:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507212544 00000100:00100000:0.0:1783946722.161870:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507212544 00000100:00100000:0.0:1783946722.161937:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:0.0:1783946722.161950:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2364:x1870603507212544:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946722.162092:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2364:x1870603507212544:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 144us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946722.162101:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:3.0:1783946722.162624:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507212672 00000100:00100000:3.0:1783946722.162632:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507212672 00000100:00100000:3.0:1783946722.162717:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:3.0:1783946722.162727:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507212672:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946722.162779:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507212672:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 55us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946722.162787:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00080000:0.0:1783946722.163042:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946722.192769:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522974208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946722.192864:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946722.193255:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522974208 00000100:00100000:1.0:1783946722.193273:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522974208 00000100:00100000:1.0:1783946722.193361:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783946722.193382:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522974208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946722.193437:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946722.193756:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522974208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 384us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946722.193764:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1783946722.193805:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783946722.195612:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be487b80 x1870603522974208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946722.195733:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522974208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783946722.457382:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946723.217935:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946723.217975:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522974336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946723.218124:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946723.218399:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522974336 00000100:00100000:1.0:1783946723.218410:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522974336 00000100:00100000:1.0:1783946723.218504:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783946723.218516:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522974336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946723.218562:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946723.218628:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522974336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946723.218636:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1783946723.218688:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be486300 x1870603522974336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946723.218711:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522974336:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783946723.220106:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783946723.220884:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522974592:0@lo:400:kworker.0 00000100:00100000:1.0:1783946723.220918:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522974848:0@lo:400:kworker.0 00000100:00100000:0.0:1783946723.221001:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522974720:0@lo:400:kworker.0 00000100:00100000:2.0:1783946723.221099:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522974464:0@lo:400:kworker.0 00000100:00100000:3.0:1783946723.221478:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946723.221588:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522974592 00000100:00100000:3.0:1783946723.221598:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522974592 00000100:00100000:3.0:1783946723.221664:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783946723.221678:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522974592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946723.221743:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522974592:12345-0@lo:400:kworker.0 Request processed in 68us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946723.221752:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783946723.221821:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522974592:0@lo:400:kworker.0 00000100:00100000:0.0:1783946723.237510:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946723.237884:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522974720 00000100:00100000:3.0:1783946723.237896:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522974720 00000100:00100000:3.0:1783946723.237981:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783946723.237996:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522974720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946723.238105:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522974720:12345-0@lo:400:kworker.0 Request processed in 114us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946723.238131:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1783946723.238672:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946723.238729:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522974720:0@lo:400:kworker.0 00000100:00100000:1.0:1783946723.248270:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946723.250369:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946723.250475:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522974976:0@lo:400:kworker.0 00000100:00100000:0.0:1783946723.250530:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522974848 00000100:00100000:0.0:1783946723.250541:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522974848 00000100:00100000:0.0:1783946723.250629:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783946723.250641:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522974848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946723.250721:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522974848:12345-0@lo:400:kworker.0 Request processed in 81us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946723.250730:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783946723.250869:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946723.250974:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522974464 00000100:00100000:1.0:1783946723.250980:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522974464 00000100:00100000:1.0:1783946723.251023:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783946723.251031:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522974464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946723.251100:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522974464:12345-0@lo:400:kworker.0 Request processed in 71us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946723.251108:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00010000:00080000:1.0:1783946723.251172:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdd6c700 x1870603522974848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946723.251191:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522974848:0@lo:400:kworker.0 00000100:00100000:2.0:1783946723.251381:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522974464:0@lo:400:kworker.0 00000100:00100000:3.0:1783946723.258302:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522974976 00000100:00100000:3.0:1783946723.258329:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522974976 00000100:00080000:0.0:1783946723.258439:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946723.258467:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783946723.258481:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522974976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946723.258653:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522974976:12345-0@lo:400:kworker.0 Request processed in 175us (7792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946723.258661:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783946723.258875:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522974976:0@lo:400:kworker.0 00010000:00010000:3.0:1783946723.473737:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946724.496444:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783946724.763247:0:9808:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:3.0:1783946725.521608:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946726.559837:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783946726.693746:0:9856:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 13 08:45:25 EDT 2026 00000100:00100000:0.0:1783946727.280979:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946727.281049:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946727.281233:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507212928 00000100:00100000:3.0:1783946727.281247:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507212928 00000100:00100000:3.0:1783946727.281552:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:3.0:1783946727.281564:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507212928:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946727.281716:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507212928:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 153us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946727.281725:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00080000:0.0:1783946727.281992:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946727.282255:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507212800 00000100:00100000:2.0:1783946727.282264:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507212800 00000100:00100000:2.0:1783946727.282347:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:2.0:1783946727.282356:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507212800:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946727.282417:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507212800:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 62us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946727.282446:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:0.0:1783946727.312602:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522975104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946727.312734:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946727.314486:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522975104 00000100:00100000:1.0:1783946727.314506:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522975104 00000100:00100000:1.0:1783946727.314633:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783946727.314648:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522975104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946727.314699:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946727.314818:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522975104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946727.314827:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783946727.314992:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783946727.315045:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdd6c700 x1870603522975104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946727.315132:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522975104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783946727.579099:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946728.336290:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522975232:0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.336351:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522975360:0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.336576:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946728.336636:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946728.336656:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522975872:0@lo:400:kworker.0 00000100:00100000:0.0:1783946728.336693:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522975744:0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.336699:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946728.336735:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946728.336748:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522975488:0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.336783:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946728.336785:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522975232 00000100:00100000:0.0:1783946728.336797:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522975232 00000100:00100000:1.0:1783946728.336809:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946728.336817:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522975616:0@lo:400:kworker.0 00000100:00100000:0.0:1783946728.336864:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783946728.336876:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522975232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946728.336952:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522975232:12345-0@lo:400:kworker.0 Request processed in 77us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946728.336963:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783946728.337044:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522975232:0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.337123:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946728.337174:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522975872 00000100:00100000:1.0:1783946728.337179:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522975872 00000100:00100000:1.0:1783946728.337231:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522975616 00000100:00100000:1.0:1783946728.337236:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522975616 00000100:00100000:1.0:1783946728.337263:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783946728.337283:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522975872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.338024:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522975872:12345-0@lo:400:kworker.0 Request processed in 737us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946728.338033:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783946728.338096:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783946728.338107:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522975616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.338156:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522975616:12345-0@lo:400:kworker.0 Request processed in 51us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946728.338163:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783946728.338185:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522975360 00000100:00100000:1.0:1783946728.338190:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522975360 00000100:00100000:1.0:1783946728.338223:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522975744 00000100:00100000:1.0:1783946728.338226:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522975744 00000100:00100000:1.0:1783946728.338239:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522975488 00000100:00100000:1.0:1783946728.338241:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522975488 00000100:00100000:1.0:1783946728.338257:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783946728.338262:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522975360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.339462:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522975360:12345-0@lo:400:kworker.0 Request processed in 1187us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946728.339475:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783946728.339518:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783946728.339532:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522975744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.339619:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522975744:12345-0@lo:400:kworker.0 Request processed in 93us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946728.339626:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783946728.339638:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783946728.339646:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522975488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.339682:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522975488:12345-0@lo:400:kworker.0 Request processed in 37us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946728.339688:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1783946728.339728:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783946728.339749:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783946728.339820:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdd6f100 x1870603522975616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946728.339856:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522975616:0@lo:400:kworker.0 00000100:00100000:1.0:1783946728.339873:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522975488:0@lo:400:kworker.0 00000100:00100000:0.0:1783946728.340110:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522975360:0@lo:400:kworker.0 00010000:00080000:0.0:1783946728.340141:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653ea00 x1870603522975872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946728.340153:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522975872:0@lo:400:kworker.0 00000100:00100000:0.0:1783946728.341261:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522975744:0@lo:400:kworker.0 00000100:00100000:3.0:1783946728.347235:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783946728.347280:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522976000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946728.348173:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946728.355304:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522976000 00000100:00100000:1.0:1783946728.355402:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522976000 00000100:00100000:0.0:1783946728.358410:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783946728.358443:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522976000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783946728.358493:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946728.358602:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522976000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (10434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946728.358626:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1783946728.359705:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23d500 x1870603522976000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946728.359742:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522976000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783946728.615201:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946729.616315:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946730.645273:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946731.664257:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946732.401347:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946732.401459:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507213184 00000100:00100000:1.0:1783946732.401475:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507213184 00000100:00100000:0.0:1783946732.401546:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946732.401565:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:1.0:1783946732.401577:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507213184:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946732.401578:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507213056 00000100:00100000:0.0:1783946732.401582:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507213056 00000100:00100000:0.0:1783946732.401614:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:0.0:1783946732.401621:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2361:x1870603507213056:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946732.401690:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2361:x1870603507213056:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946732.401698:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00080000:2.0:1783946732.404043:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946732.405606:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507213184:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 4016us (4329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946732.405636:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:1.0:1783946732.433298:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946732.433849:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522976128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946732.433978:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946732.434240:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522976128 00000100:00100000:3.0:1783946732.434252:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522976128 00000100:00080000:2.0:1783946732.434408:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946732.434532:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783946732.434548:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522976128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783946732.434598:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946732.435451:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522976128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 903us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946732.435461:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1783946732.444132:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b653ea00 x1870603522976128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946732.444171:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522976128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783946732.692491:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946733.458301:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522976256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946733.458445:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946733.458573:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522976256 00000100:00100000:0.0:1783946733.458584:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522976256 00000100:00100000:0.0:1783946733.458672:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783946733.458685:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522976256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783946733.458731:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946733.458791:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522976256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946733.458799:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1783946733.458830:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783946733.458869:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23d500 x1870603522976256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946733.458893:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522976256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946733.459734:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522976512:0@lo:400:kworker.0 00000100:00100000:3.0:1783946733.459808:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946733.459841:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783946733.459846:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522976640:0@lo:400:kworker.0 00000100:00100000:3.0:1783946733.459869:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946733.459909:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522976512 00000100:00100000:3.0:1783946733.459918:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522976512 00000100:00100000:3.0:1783946733.459971:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522976640 00000100:00100000:3.0:1783946733.459974:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522976640 00000100:00100000:3.0:1783946733.460004:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783946733.460012:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522976512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946733.460092:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522976512:12345-0@lo:400:kworker.0 Request processed in 80us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946733.460100:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783946733.460118:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783946733.460124:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522976640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946733.460152:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522976640:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946733.460158:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1783946733.460382:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946733.460524:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522976384:0@lo:400:kworker.0 00000100:00100000:2.0:1783946733.460573:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946733.460609:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522976896:0@lo:400:kworker.0 00000100:00100000:2.0:1783946733.460635:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946733.460664:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522976768:0@lo:400:kworker.0 00000100:00100000:0.0:1783946733.460701:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946733.460747:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522976384 00000100:00100000:0.0:1783946733.460752:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522976384 00000100:00100000:0.0:1783946733.460803:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1783946733.460812:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522976384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946733.460848:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522976384:12345-0@lo:400:kworker.0 Request processed in 37us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946733.460855:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1783946733.460896:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522976768 00000100:00100000:0.0:1783946733.460900:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522976768 00000100:00100000:0.0:1783946733.460931:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783946733.460938:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522976768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946733.460976:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522976768:12345-0@lo:400:kworker.0 Request processed in 38us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946733.460983:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783946733.461028:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be486300 x1870603522976768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946733.461043:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522976768:0@lo:400:kworker.0 00000100:00100000:2.0:1783946733.473676:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522976384:0@lo:400:kworker.0 00000100:00100000:0.0:1783946733.477960:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522976896 00000100:00100000:0.0:1783946733.477983:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522976896 00000100:00100000:0.0:1783946733.478108:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783946733.478119:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522976896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946733.495109:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522976640:0@lo:400:kworker.0 00000100:00100000:1.0:1783946733.495140:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522976512:0@lo:400:kworker.0 00000100:00100000:0.0:1783946733.503841:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522976896:12345-0@lo:400:kworker.0 Request processed in 25708us (43188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946733.503863:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1783946733.503974:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946733.507839:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522976896:0@lo:400:kworker.0 00010000:00010000:2.0:1783946733.720104:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946734.738873:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946735.762534:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946736.787240:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946737.520391:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946737.520452:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946737.520527:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507213312 00000100:00100000:3.0:1783946737.520542:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507213312 00000100:00100000:3.0:1783946737.520669:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:3.0:1783946737.520681:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507213312:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946737.520778:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507213312:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 99us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946737.520787:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:3.0:1783946737.524171:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507213440 00000100:00100000:3.0:1783946737.524195:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507213440 00000100:00100000:3.0:1783946737.524302:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:3.0:1783946737.524317:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507213440:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946737.524428:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507213440:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 113us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946737.524437:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00080000:2.0:1783946737.525803:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946737.556355:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783946737.556396:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522977024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946737.556502:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946737.556582:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522977024 00000100:00100000:1.0:1783946737.556603:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522977024 00000100:00100000:1.0:1783946737.556690:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783946737.556701:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522977024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946737.556742:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946737.556802:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522977024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946737.556810:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1783946737.556880:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137812ea300 x1870603522977024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946737.559566:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522977024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783946737.560583:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783946737.808923:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946738.576993:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522977408:0@lo:400:kworker.0 00000100:00100000:1.0:1783946738.577132:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946738.577214:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522977920:0@lo:400:kworker.0 00000100:00100000:1.0:1783946738.577245:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946738.577274:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783946738.577279:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522977280:0@lo:400:kworker.0 00000100:00100000:1.0:1783946738.577304:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946738.577317:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522977792:0@lo:400:kworker.0 00000100:00100000:1.0:1783946738.577331:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946738.577356:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522977920 00000100:00100000:1.0:1783946738.577363:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522977920 00000100:00100000:1.0:1783946738.577417:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783946738.577424:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522977920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946738.577472:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522977920:12345-0@lo:400:kworker.0 Request processed in 48us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946738.577490:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1783946738.577541:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137812e8e00 x1870603522977920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946738.577557:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522977920:0@lo:400:kworker.0 00000100:00100000:2.0:1783946738.577723:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522977536:0@lo:400:kworker.0 00000100:00100000:2.0:1783946738.577751:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946738.577784:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783946738.577790:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522977152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946738.577825:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946738.577842:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522977664:0@lo:400:kworker.0 00000100:00100000:2.0:1783946738.577857:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946738.577878:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522977408 00000100:00100000:2.0:1783946738.577881:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522977408 00000100:00100000:2.0:1783946738.577905:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522977792 00000100:00100000:2.0:1783946738.577906:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522977792 00000100:00100000:2.0:1783946738.577916:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522977536 00000100:00100000:2.0:1783946738.577918:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522977536 00000100:00100000:2.0:1783946738.577928:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783946738.577932:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522977408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946738.577958:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522977408:12345-0@lo:400:kworker.0 Request processed in 26us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946738.577962:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783946738.577972:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783946738.577976:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522977792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946738.577993:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522977792:12345-0@lo:400:kworker.0 Request processed in 17us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946738.577999:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783946738.578009:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783946738.578015:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522977536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946738.578044:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522977536:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946738.578051:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783946738.578132:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522977152 00000100:00100000:2.0:1783946738.578137:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522977152 00000100:00100000:2.0:1783946738.578165:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783946738.578179:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522977152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783946738.578209:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946738.578243:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522977152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946738.578249:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1783946738.578285:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be347b80 x1870603522977152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946738.578298:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522977152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946738.578305:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522977536:0@lo:400:kworker.0 00000100:00100000:2.0:1783946738.578328:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522977792:0@lo:400:kworker.0 00000100:00100000:2.0:1783946738.578335:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522977408:0@lo:400:kworker.0 00000100:00100000:0.0:1783946738.578445:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522977280 00000100:00100000:0.0:1783946738.578450:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522977280 00000100:00100000:0.0:1783946738.578483:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783946738.578489:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522977280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946738.578526:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522977280:12345-0@lo:400:kworker.0 Request processed in 38us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946738.578530:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:0.0:1783946738.578564:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783946738.578568:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783946738.578576:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522977664 00000100:00100000:0.0:1783946738.578578:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522977664 00000100:00100000:0.0:1783946738.578595:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783946738.578599:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522977664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946738.578624:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522977664:12345-0@lo:400:kworker.0 Request processed in 25us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946738.578627:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1783946738.578645:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137812e9880 x1870603522977664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946738.578651:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522977664:0@lo:400:kworker.0 00000100:00100000:0.0:1783946738.578664:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522977280:0@lo:400:kworker.0 00010000:00010000:3.0:1783946738.832344:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946739.873742:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946740.881421:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946741.911423:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946742.640549:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946742.640603:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946742.640813:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507213696 00000100:00100000:2.0:1783946742.640824:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507213696 00000100:00100000:2.0:1783946742.640899:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:2.0:1783946742.640911:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507213696:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946742.641004:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507213696:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 94us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946742.641012:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00080000:0.0:1783946742.641247:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946742.641527:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507213568 00000100:00100000:1.0:1783946742.641538:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507213568 00000100:00100000:1.0:1783946742.641582:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:1.0:1783946742.641590:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507213568:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946742.641634:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507213568:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 45us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946742.641642:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:3.0:1783946742.672427:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783946742.672460:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522978048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946742.672563:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946742.672835:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522978048 00000100:00100000:1.0:1783946742.672847:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522978048 00000100:00100000:1.0:1783946742.672943:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783946742.672957:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522978048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946742.672990:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946742.673048:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522978048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946742.673085:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1783946742.673194:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783946742.673265:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137812e8e00 x1870603522978048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946742.673286:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522978048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783946742.928392:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946743.696282:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946743.696312:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522978176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946743.696411:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946743.696562:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522978176 00000100:00100000:0.0:1783946743.696586:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522978176 00000100:00100000:0.0:1783946743.696662:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783946743.696674:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522978176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783946743.696703:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946743.696751:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522978176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946743.696759:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1783946743.696801:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be346300 x1870603522978176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946743.696821:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522978176:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783946743.697221:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946743.697633:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522978560:0@lo:400:kworker.0 00000100:00100000:2.0:1783946743.697643:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522978432:0@lo:400:kworker.0 00000100:00100000:1.0:1783946743.697684:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946743.697713:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946743.697733:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946743.697741:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522978688:0@lo:400:kworker.0 00000100:00100000:2.0:1783946743.697744:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783946743.697754:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522978304:0@lo:400:kworker.0 00000100:00100000:1.0:1783946743.697775:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946743.697792:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946743.697826:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522978560 00000100:00100000:2.0:1783946743.697830:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522978816:0@lo:400:kworker.0 00000100:00100000:1.0:1783946743.697834:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522978560 00000100:00100000:2.0:1783946743.697860:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946743.697898:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522978304 00000100:00100000:2.0:1783946743.697902:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522978304 00000100:00100000:2.0:1783946743.697936:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1783946743.697944:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522978304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946743.698002:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522978304:12345-0@lo:400:kworker.0 Request processed in 59us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946743.698020:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1783946743.698089:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522978304:0@lo:400:kworker.0 00000100:00100000:2.0:1783946743.698109:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522978432 00000100:00100000:2.0:1783946743.698112:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522978432 00000100:00100000:2.0:1783946743.698128:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522978816 00000100:00100000:2.0:1783946743.698131:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522978816 00000100:00100000:2.0:1783946743.698145:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783946743.698152:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522978560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946743.698190:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522978560:12345-0@lo:400:kworker.0 Request processed in 38us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946743.698196:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783946743.698210:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783946743.698216:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522978432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946743.698245:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522978432:12345-0@lo:400:kworker.0 Request processed in 29us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946743.698257:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783946743.698270:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783946743.698275:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522978816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946743.698301:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522978816:12345-0@lo:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946743.698307:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783946743.698331:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522978816:0@lo:400:kworker.0 00000100:00100000:2.0:1783946743.698340:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522978432:0@lo:400:kworker.0 00000100:00100000:0.0:1783946743.698555:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522978688 00000100:00100000:0.0:1783946743.698560:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522978688 00000100:00100000:0.0:1783946743.698591:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783946743.698598:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522978688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946743.698635:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522978688:12345-0@lo:400:kworker.0 Request processed in 38us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946743.698642:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1783946743.698666:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783946743.698703:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137812ea680 x1870603522978688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946743.698715:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522978688:0@lo:400:kworker.0 00000100:00100000:0.0:1783946743.698726:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522978560:0@lo:400:kworker.0 00010000:00010000:3.0:1783946743.953093:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783946744.688461:0:10488:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:45:43 (1783946743) === 00010000:00010000:3.0:1783946744.976297:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946745.393827:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946745.393935:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507213824 00000100:00100000:1.0:1783946745.393950:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507213824 00000100:00100000:1.0:1783946745.395309:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:1.0:1783946745.395329:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:7987:x1870603507213824:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783946745.395350:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946745.395375:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44200/0x229d2ec450db7318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571dc6 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946745.395413:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44200/0x229d2ec450db7318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571dc6 expref: 11 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946745.395427:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44200/0x229d2ec450db7318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571dc6 expref: 11 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946745.395437:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44200, rc 0) 00000100:00100000:1.0:1783946745.395591:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7987:x1870603507213824:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 268us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946745.395601:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:2.0:1783946745.402973:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946745.403107:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507213952 00000100:00100000:0.0:1783946745.403133:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507213952 00000100:00100000:0.0:1783946745.403201:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 214 00000100:00100000:0.0:1783946745.403213:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7987:x1870603507213952:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783946745.403377:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7987:x1870603507213952:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 166us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946745.403385:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 214 00000100:00100000:3.0:1783946745.406823:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946745.406940:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507214080 00000100:00100000:2.0:1783946745.406950:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507214080 00000100:00100000:2.0:1783946745.407037:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:2.0:1783946745.407049:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7987:x1870603507214080:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783946745.407226:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7987:x1870603507214080:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 179us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946745.407235:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:3.0:1783946745.428330:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946745.428460:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507214208 00000100:00100000:1.0:1783946745.428474:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507214208 00000100:00100000:1.0:1783946745.428546:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:1.0:1783946745.428560:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7991:x1870603507214208:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783946745.428746:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7991:x1870603507214208:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 188us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946745.428755:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:3.0:1783946745.451620:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946745.451722:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507214336 00000100:00100000:0.0:1783946745.451732:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507214336 00000100:00100000:0.0:1783946745.451800:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:0.0:1783946745.451811:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7991:x1870603507214336:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783946745.452680:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7991:x1870603507214336:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 196us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946745.452694:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:3.0:1783946745.469550:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946745.469908:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507214464 00000100:00100000:2.0:1783946745.469920:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507214464 00000100:00100000:2.0:1783946745.469997:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 218 00000100:00100000:2.0:1783946745.470017:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:7987:x1870603507214464:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783946745.470034:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946745.470053:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797623000/0x229d2ec450db731f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571df0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946745.470122:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797623000/0x229d2ec450db731f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571df0 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946745.470150:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797623000/0x229d2ec450db731f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571df0 expref: 12 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946745.470160:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623000, rc 0) 00000100:00100000:2.0:1783946745.470233:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:7987:x1870603507214464:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 218us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946745.470241:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 218 00000100:00100000:3.0:1783946745.484229:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946745.486943:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507214592 00000100:00100000:1.0:1783946745.486990:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507214592 00000100:00100000:1.0:1783946745.487112:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:1.0:1783946745.487126:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:7987:x1870603507214592:12345-192.168.201.18@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783946745.487157:0:5950:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783946745.487176:0:5950:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783946745.487181:0:5950:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783946745.487184:0:5950:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783946745.487187:0:5950:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1783946745.489762:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:7987:x1870603507214592:12345-192.168.201.18@tcp:256:mount.lustre.0 Request processed in 2632us (5535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946745.489777:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:3.0:1783946745.499482:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946745.499725:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507214720 00000100:00100000:0.0:1783946745.499738:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507214720 00000100:00100000:0.0:1783946745.499819:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 220 00000100:00100000:0.0:1783946745.499831:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:7987:x1870603507214720:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783946745.499855:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946745.499890:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571df7 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946745.499928:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571df7 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946745.499942:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571df7 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946745.500207:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35be400, rc 0) 00000100:00100000:0.0:1783946745.500291:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:7987:x1870603507214720:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 461us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946745.500299:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 220 00000100:00100000:3.0:1783946745.506987:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946745.507317:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507214848 00000100:00100000:1.0:1783946745.507336:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507214848 00000100:00100000:1.0:1783946745.507436:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:1.0:1783946745.507449:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:7987:x1870603507214848:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783946745.507619:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:7987:x1870603507214848:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 172us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946745.507629:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:3.0:1783946745.510709:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946745.511389:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507214976 00000100:00100000:2.0:1783946745.511405:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507214976 00000100:00100000:2.0:1783946745.511501:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 222 00000100:00100000:2.0:1783946745.511513:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:7987:x1870603507214976:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783946745.511733:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:7987:x1870603507214976:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 220us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946745.511742:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 222 00000100:00100000:3.0:1783946745.519168:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946745.519935:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507215104 00000100:00100000:0.0:1783946745.519953:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507215104 00000100:00100000:0.0:1783946745.520043:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:0.0:1783946745.520054:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:7995:x1870603507215104:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783946745.520273:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:7995:x1870603507215104:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 219us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946745.520281:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:3.0:1783946745.523831:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946745.525717:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507215232 00000100:00100000:1.0:1783946745.525739:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507215232 00000100:00100000:1.0:1783946745.525848:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 224 00000100:00100000:1.0:1783946745.525861:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:7995:x1870603507215232:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783946745.526182:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:7995:x1870603507215232:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 322us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946745.526193:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 224 00000100:00100000:3.0:1783946745.537325:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946745.537627:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507215744 00000100:00100000:2.0:1783946745.537645:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507215744 00000100:00100000:2.0:1783946745.537763:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:2.0:1783946745.537777:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507215744:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:0.0:1783946745.538131:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946745.546776:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507215744:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 8984us (9448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946745.546799:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:0.0:1783946745.555199:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946745.555491:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507215360 00000100:00100000:2.0:1783946745.555509:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507215360 00000100:00100000:2.0:1783946745.555571:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1783946745.555581:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1870603507215360:12345-192.168.201.18@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783946745.555633:0:5958:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from d5851e04-311c-4929-a2c6-87673cd4c005@192.168.201.18@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:2.0:1783946745.555677:0:5958:0:(genops.c:1406:class_connect()) connect: client d5851e04-311c-4929-a2c6-87673cd4c005, cookie 0x229d2ec450db732d 00000004:00100000:2.0:1783946745.555707:0:5958:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783946745.555857:0:5958:0:(import.c:65:import_set_state_nolock()) ffff9137bdf73000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783946745.555929:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+6:2360:x1870603507215360:12345-192.168.201.18@tcp:38:mount.lustre.0 Request processed in 348us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946745.555937:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1783946745.561621:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946745.561674:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946745.561750:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507215616 00000100:00100000:1.0:1783946745.561786:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507215616 00000100:00100000:1.0:1783946745.561877:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507215488 00000100:00100000:1.0:1783946745.561886:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507215488 00000100:00100000:1.0:1783946745.561917:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:1.0:1783946745.561927:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+7:7987:x1870603507215616:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783946745.561966:0:5956:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:3.0:1783946745.562087:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1783946745.562108:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+7:0:x1870603507215488:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783946745.562140:0:5958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00080000:0.0:1783946745.562285:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946745.562366:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+7:7987:x1870603507215616:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 438us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946745.562376:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1783946745.562578:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+6:0:x1870603507215488:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 475us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946745.562588:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1783946745.572206:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946745.573781:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507215872 00000100:00100000:1.0:1783946745.573796:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507215872 00000100:00100000:1.0:1783946745.573872:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1783946745.573885:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+6:7987:x1870603507215872:12345-192.168.201.18@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783946745.574027:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+6:7987:x1870603507215872:12345-192.168.201.18@tcp:40:mount.lustre.0 Request processed in 144us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946745.574035:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1783946745.582206:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946745.582261:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946745.582295:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946745.582329:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507216256 00000100:00100000:3.0:1783946745.582349:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507216256 00000100:00100000:0.0:1783946745.582424:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507216000 00000100:00100000:0.0:1783946745.582436:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507216000 00000100:00100000:0.0:1783946745.582488:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507216128 00000100:00100000:0.0:1783946745.582491:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507216128 00000100:00100000:0.0:1783946745.582512:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1783946745.582521:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870603507216000:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783946745.582557:0:6942:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d5851e04-311c-4929-a2c6-87673cd4c005@192.168.201.18@tcp t0 exp 0000000000000000 cur 349 last 0 00000100:00100000:3.0:1783946745.582594:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000020:00000080:0.0:1783946745.582594:0:6942:0:(genops.c:1406:class_connect()) connect: client d5851e04-311c-4929-a2c6-87673cd4c005, cookie 0x229d2ec450db7334 00002000:00100000:0.0:1783946745.582611:0:6942:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d5851e04-311c-4929-a2c6-87673cd4c005/ffff9137b65da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1783946745.582621:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:7987:x1870603507216256:12345-192.168.201.18@tcp:33:mount.lustre.0 00002000:00100000:0.0:1783946745.582650:0:6942:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783946745.582741:0:6942:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000004:00200000:3.0:1783946745.582773:0:5959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00080000:0.0:1783946745.582776:0:6942:0:(import.c:65:import_set_state_nolock()) ffff9137b65dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783946745.582863:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:2360:x1870603507216000:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 340us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946745.582873:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1783946745.582891:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:7987:x1870603507216256:12345-192.168.201.18@tcp:33:mount.lustre.0 Request processed in 269us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946745.582903:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1783946745.582912:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870603507216128:12345-192.168.201.18@tcp:8:mount.lustre.0 00000100:00100000:3.0:1783946745.582933:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00010000:00080000:0.0:1783946745.582940:0:6942:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d5851e04-311c-4929-a2c6-87673cd4c005@192.168.201.18@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:0.0:1783946745.582964:0:6942:0:(genops.c:1406:class_connect()) connect: client d5851e04-311c-4929-a2c6-87673cd4c005, cookie 0x229d2ec450db733b 00002000:00100000:1.0:1783946745.583528:0:6942:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d5851e04-311c-4929-a2c6-87673cd4c005/ffff9137b65df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783946745.583544:0:6942:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783946745.583602:0:6942:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783946745.583624:0:6942:0:(import.c:65:import_set_state_nolock()) ffff9137bdc7d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783946745.583677:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:2360:x1870603507216128:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 763us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946745.583686:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00010000:00010000:3.0:1783946746.000571:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946747.024503:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946747.793590:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783946747.793637:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522978944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946747.793740:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946747.793835:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522978944 00000100:00100000:1.0:1783946747.793845:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522978944 00000100:00100000:1.0:1783946747.793921:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783946747.793932:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522978944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946747.793986:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946747.794044:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522978944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946747.794052:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1783946747.794096:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783946747.794138:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137812e8a80 x1870603522978944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946747.794172:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522978944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783946748.049020:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946748.826660:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522979200:0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.827865:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946748.828787:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522979712:0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.828845:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946748.828895:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783946748.828903:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522979072:0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.830797:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946748.830875:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522979584:0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.830938:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946748.833248:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522979328:0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.833317:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946748.833345:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522979840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946748.833370:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946748.833394:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946748.842135:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522979456:0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.842236:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946748.842313:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522979200 00000100:00100000:3.0:1783946748.842323:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522979200 00000100:00100000:3.0:1783946748.842388:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522979584 00000100:00100000:3.0:1783946748.842392:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522979584 00000100:00100000:3.0:1783946748.842431:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522979328 00000100:00100000:3.0:1783946748.842434:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522979328 00000100:00100000:3.0:1783946748.842451:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783946748.842469:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522979200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.842536:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522979200:12345-0@lo:400:kworker.0 Request processed in 66us (14678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946748.842544:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783946748.842568:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783946748.842574:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522979584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.842604:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522979584:12345-0@lo:400:kworker.0 Request processed in 30us (11665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946748.842610:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783946748.842624:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783946748.842630:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522979328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.842663:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522979328:12345-0@lo:400:kworker.0 Request processed in 33us (9346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946748.842669:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783946748.842810:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522979712 00000100:00100000:1.0:1783946748.842816:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522979712 00000100:00100000:1.0:1783946748.842850:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522979456 00000100:00100000:1.0:1783946748.842853:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522979456 00000100:00100000:1.0:1783946748.842871:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783946748.842877:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522979712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946748.842914:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522979712:12345-0@lo:400:kworker.0 Request processed in 37us (14068us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946748.842931:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783946748.842952:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783946748.842959:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522979456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946748.842986:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522979456:12345-0@lo:400:kworker.0 Request processed in 29us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946748.842992:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1783946748.844836:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783946748.844846:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946748.844872:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522979840 00000100:00100000:2.0:1783946748.844885:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522979840 00000100:00100000:2.0:1783946748.847421:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783946748.847445:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522979840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783946748.847488:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946748.847594:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522979840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (14221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946748.847604:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783946748.847863:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522979584:0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.847883:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522979200:0@lo:400:kworker.0 00010000:00080000:3.0:1783946748.847901:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be345500 x1870603522979712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946748.847914:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522979712:0@lo:400:kworker.0 00010000:00080000:3.0:1783946748.847976:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be345c00 x1870603522979456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946748.847986:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522979456:0@lo:400:kworker.0 00000100:00100000:3.0:1783946748.848002:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522979328:0@lo:400:kworker.0 00010000:00080000:3.0:1783946748.848029:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be347480 x1870603522979840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946748.848044:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522979840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946748.854040:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522979072 00000100:00100000:2.0:1783946748.854097:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522979072 00000100:00100000:2.0:1783946748.854164:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783946748.854175:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522979072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946748.854531:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522979072:12345-0@lo:400:kworker.0 Request processed in 357us (25584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946748.854553:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783946748.854808:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522979072:0@lo:400:kworker.0 00010000:00010000:3.0:1783946749.081903:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946750.096321:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946750.835594:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946750.835637:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946750.835664:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946750.835692:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946750.835737:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946750.835764:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507216640 00000100:00100000:2.0:1783946750.835775:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507216640 00000100:00100000:2.0:1783946750.835846:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507216512 00000100:00100000:2.0:1783946750.835850:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507216512 00000100:00100000:2.0:1783946750.835871:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:2.0:1783946750.835880:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:2361:x1870603507216640:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946750.835975:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:2361:x1870603507216640:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 95us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946750.835982:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:2.0:1783946750.836010:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:2.0:1783946750.836016:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507216512:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946750.836039:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507216512:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946750.836045:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00080000:2.0:1783946750.836107:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946750.836247:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507216896 00000100:00100000:0.0:1783946750.836251:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507216896 00000100:00100000:0.0:1783946750.836297:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507216768 00000100:00100000:0.0:1783946750.836300:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507216768 00000100:00100000:0.0:1783946750.836318:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:0.0:1783946750.836324:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+6:2361:x1870603507216896:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946750.836350:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+6:2361:x1870603507216896:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946750.836356:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:0.0:1783946750.836368:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1783946750.836373:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+6:2361:x1870603507216768:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946750.836393:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+6:2361:x1870603507216768:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 20us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946750.836410:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00080000:2.0:1783946750.838131:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783946750.838142:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946750.838563:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507216384 00000100:00100000:1.0:1783946750.838589:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507216384 00000100:00100000:1.0:1783946750.838657:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 226 00000100:00100000:1.0:1783946750.838668:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507216384:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946750.838738:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507216384:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 73us (3153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946750.838746:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 226 00000001:00100000:0.0:1783946750.872018:0:5935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d5851e04-311c-4929-a2c6-87673cd4c005 00000001:00100000:0.0:1783946750.873237:0:8015:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d5851e04-311c-4929-a2c6-87673cd4c005 00000001:00100000:1.0:1783946750.878540:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d5851e04-311c-4929-a2c6-87673cd4c005 00010000:00010000:3.0:1783946751.120654:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946752.149643:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783946752.641446:0:10681:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1783946752.913779:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522979968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946752.913906:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946752.914028:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522979968 00000100:00100000:3.0:1783946752.914041:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522979968 00000100:00100000:3.0:1783946752.914167:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783946752.914180:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522979968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783946752.914229:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946752.914293:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522979968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946752.914302:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1783946752.914333:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783946752.914377:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be347480 x1870603522979968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946752.914403:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522979968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783946753.168371:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946753.942049:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522980224:0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942193:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946753.942253:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522980736:0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942281:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946753.942310:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783946753.942316:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522980096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946753.942339:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946753.942355:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522980608:0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942375:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946753.942400:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522980352:0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942454:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946753.942474:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522980864:0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942493:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946753.942510:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783946753.942515:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522980480:0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942533:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946753.942570:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522980224 00000100:00100000:1.0:1783946753.942585:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522980224 00000100:00100000:1.0:1783946753.942643:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783946753.942653:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522980224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942710:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522980224:12345-0@lo:400:kworker.0 Request processed in 57us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946753.942718:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783946753.942756:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522980736 00000100:00100000:1.0:1783946753.942759:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522980736 00000100:00100000:1.0:1783946753.942797:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522980352 00000100:00100000:1.0:1783946753.942801:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522980352 00000100:00100000:1.0:1783946753.942813:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522980480 00000100:00100000:1.0:1783946753.942816:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522980480 00000100:00100000:1.0:1783946753.942844:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783946753.942851:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522980736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942885:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522980736:12345-0@lo:400:kworker.0 Request processed in 35us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946753.942892:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783946753.942903:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783946753.942908:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522980352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942935:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522980352:12345-0@lo:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946753.942940:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783946753.942950:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783946753.942955:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522980480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.942978:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522980480:12345-0@lo:400:kworker.0 Request processed in 23us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946753.942985:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783946753.943013:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522980096 00000100:00100000:1.0:1783946753.943017:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522980096 00000100:00100000:1.0:1783946753.943045:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783946753.943050:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522980096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946753.943101:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946753.943136:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522980096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946753.943142:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783946753.943161:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522980608 00000100:00100000:1.0:1783946753.943164:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522980608 00000100:00100000:1.0:1783946753.943186:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522980864 00000100:00100000:1.0:1783946753.943188:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522980864 00000100:00100000:1.0:1783946753.943201:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783946753.943206:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522980608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.943234:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522980608:12345-0@lo:400:kworker.0 Request processed in 27us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946753.943239:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783946753.943248:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783946753.943254:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522980864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.943275:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522980864:12345-0@lo:400:kworker.0 Request processed in 21us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946753.943280:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1783946753.943314:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783946753.943319:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946753.943369:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522980480:0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.943379:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522980352:0@lo:400:kworker.0 00010000:00080000:1.0:1783946753.943392:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137812e9880 x1870603522980864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946753.943411:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522980864:0@lo:400:kworker.0 00010000:00080000:1.0:1783946753.943450:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137812e8a80 x1870603522980096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946753.943464:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522980096:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783946753.943475:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137812e8e00 x1870603522980608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946753.943483:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522980608:0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.943492:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522980224:0@lo:400:kworker.0 00000100:00100000:1.0:1783946753.943502:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522980736:0@lo:400:kworker.0 00010000:00010000:1.0:1783946754.192314:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946755.216854:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946755.955945:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946755.955986:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946755.956018:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946755.956041:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946755.956084:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946755.956116:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507217408 00000100:00100000:1.0:1783946755.956125:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507217408 00000100:00100000:1.0:1783946755.956180:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507217536 00000100:00100000:1.0:1783946755.956183:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507217536 00000100:00100000:1.0:1783946755.956208:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:1.0:1783946755.956218:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507217408:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946755.956298:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507217408:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946755.956318:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:1.0:1783946755.956337:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:1.0:1783946755.956343:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507217536:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946755.956369:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507217536:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946755.956376:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:1.0:1783946755.956396:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507217024 00000100:00100000:1.0:1783946755.956400:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507217024 00000100:00100000:1.0:1783946755.956426:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 228 00000100:00100000:1.0:1783946755.956433:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507217024:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946755.956456:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507217024:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946755.956463:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 228 00000100:00100000:1.0:1783946755.956489:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507217152 00000100:00100000:1.0:1783946755.956492:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507217152 00000100:00100000:1.0:1783946755.956517:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507217280 00000100:00100000:1.0:1783946755.956520:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507217280 00000100:00100000:1.0:1783946755.956541:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:1.0:1783946755.956548:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507217152:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946755.956577:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507217152:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 30us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946755.956584:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:1.0:1783946755.956596:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:1.0:1783946755.956603:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507217280:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946755.956635:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507217280:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 33us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946755.956641:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00080000:1.0:1783946755.956664:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783946755.956668:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783946755.956670:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783946756.242204:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946757.264626:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946758.032343:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522980992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946758.032431:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946758.032534:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522980992 00000100:00100000:3.0:1783946758.032541:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522980992 00000100:00100000:3.0:1783946758.032771:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783946758.032782:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522980992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783946758.032917:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946758.032970:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522980992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946758.032977:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1783946758.032998:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783946758.033028:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be347480 x1870603522980992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946758.033047:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522980992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783946758.293282:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946759.059545:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522981120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946759.059653:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946759.059932:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522981248:0@lo:400:kworker.0 00000100:00100000:1.0:1783946759.059977:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946759.060037:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522981248 00000100:00100000:1.0:1783946759.060046:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522981248 00000100:00100000:1.0:1783946759.060138:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783946759.060150:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522981248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946759.060212:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522981248:12345-0@lo:400:kworker.0 Request processed in 63us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946759.060223:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783946759.060286:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522981248:0@lo:400:kworker.0 00000100:00100000:3.0:1783946759.064332:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522981120 00000100:00100000:3.0:1783946759.064356:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522981120 00000100:00100000:3.0:1783946759.065589:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783946759.065607:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522981120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783946759.065664:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946759.065804:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522981120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (6150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946759.065813:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1783946759.065882:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be3f0e00 x1870603522981120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946759.065908:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522981120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946759.066243:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522981760:0@lo:400:kworker.0 00000100:00100000:0.0:1783946759.066292:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946759.066324:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783946759.066330:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522981632:0@lo:400:kworker.0 00000100:00100000:0.0:1783946759.066357:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946759.066387:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522981760 00000100:00100000:0.0:1783946759.066394:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522981760 00000100:00100000:3.0:1783946759.068140:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522981376:0@lo:400:kworker.0 00000100:00100000:3.0:1783946759.068230:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946759.068282:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946759.068289:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522981504:0@lo:400:kworker.0 00000100:00100000:3.0:1783946759.068312:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946759.068360:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522981376 00000100:00100000:3.0:1783946759.068369:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522981376 00000100:00100000:3.0:1783946759.068438:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522981504 00000100:00100000:3.0:1783946759.068442:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522981504 00000100:00080000:1.0:1783946759.068622:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946759.068715:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783946759.068761:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522981376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946759.068844:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522981376:12345-0@lo:400:kworker.0 Request processed in 102us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946759.068853:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783946759.071340:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522981376:0@lo:400:kworker.0 00000100:00080000:2.0:1783946759.081107:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783946759.081770:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783946759.081793:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522981760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946759.081944:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522981760:12345-0@lo:400:kworker.0 Request processed in 161us (15651us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946759.081952:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783946759.081986:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522981632 00000100:00100000:0.0:1783946759.081996:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522981632 00000100:00100000:0.0:1783946759.082035:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783946759.082042:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522981632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946759.082100:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522981632:12345-0@lo:400:kworker.0 Request processed in 58us (15742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946759.082107:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1783946759.082176:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be472680 x1870603522981632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946759.082197:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522981632:0@lo:400:kworker.0 00000100:00100000:1.0:1783946759.082216:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522981760:0@lo:400:kworker.0 00000100:00100000:0.0:1783946759.086633:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783946759.086656:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522981504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946759.089199:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522981504:12345-0@lo:400:kworker.0 Request processed in 2537us (20869us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946759.089236:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783946759.090239:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522981504:0@lo:400:kworker.0 00010000:00010000:1.0:1783946759.316212:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946760.336371:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946761.075685:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946761.075748:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946761.075840:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507217792 00000100:00100000:0.0:1783946761.075855:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507217792 00000100:00100000:0.0:1783946761.075949:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:0.0:1783946761.075963:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507217792:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946761.076099:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507217792:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 139us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946761.076108:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:1.0:1783946761.076379:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946761.076413:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946761.076468:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946761.077585:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507217664 00000100:00100000:0.0:1783946761.077600:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507217664 00000100:00100000:0.0:1783946761.077671:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 230 00000100:00100000:0.0:1783946761.077681:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507217664:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946761.077799:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507217664:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 118us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946761.077808:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 230 00000100:00100000:3.0:1783946761.080185:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507217920 00000100:00100000:3.0:1783946761.080218:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507217920 00000100:00100000:3.0:1783946761.080287:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:3.0:1783946761.080296:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507217920:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946761.080403:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507217920:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 108us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946761.080411:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00080000:3.0:1783946761.080579:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946761.086746:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507218048 00000100:00100000:2.0:1783946761.086768:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507218048 00000100:00100000:2.0:1783946761.090084:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507218176 00000100:00100000:2.0:1783946761.090111:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507218176 00000100:00100000:0.0:1783946761.090649:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:0.0:1783946761.090668:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a5f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507218048:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946761.090820:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a5f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507218048:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 157us (15069us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946761.090829:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00080000:3.0:1783946761.093009:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783946761.093021:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946761.093553:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:2.0:1783946761.093571:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507218176:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946761.093676:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507218176:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 112us (17209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946761.093685:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00010000:00010000:1.0:1783946761.360953:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783946761.663655:0:10943:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783946761.669943:0:10943:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783946762.387479:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946763.155818:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522981888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946763.155933:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946763.158039:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522981888 00000100:00100000:3.0:1783946763.158084:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522981888 00000100:00100000:3.0:1783946763.158197:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783946763.158210:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522981888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783946763.158260:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946763.158373:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522981888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946763.158382:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1783946763.158460:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be3f3480 x1870603522981888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946763.158485:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522981888:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783946763.158685:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783946763.411162:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946764.176404:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522982272:0@lo:400:kworker.0 00000100:00100000:0.0:1783946764.176539:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946764.176635:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783946764.176641:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522982144:0@lo:400:kworker.0 00000100:00100000:0.0:1783946764.176675:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946764.176694:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522982656:0@lo:400:kworker.0 00000100:00100000:0.0:1783946764.176717:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946764.176756:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522982272 00000100:00100000:0.0:1783946764.176765:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522982272 00000100:00100000:0.0:1783946764.176829:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522982144 00000100:00100000:0.0:1783946764.176832:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522982144 00000100:00100000:0.0:1783946764.176853:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783946764.176861:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522982272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946764.176926:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522982272:12345-0@lo:400:kworker.0 Request processed in 53us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946764.176934:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783946764.176950:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783946764.176955:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522982144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946764.176977:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522982144:12345-0@lo:400:kworker.0 Request processed in 22us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946764.176983:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783946764.177004:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522982656 00000100:00100000:0.0:1783946764.177007:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522982656 00000100:00100000:0.0:1783946764.177034:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783946764.177040:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522982656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946764.177097:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522982656:12345-0@lo:400:kworker.0 Request processed in 57us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946764.177103:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1783946764.177118:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783946764.177130:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946764.177174:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522982144:0@lo:400:kworker.0 00010000:00080000:0.0:1783946764.177188:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be470a80 x1870603522982656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946764.177199:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522982656:0@lo:400:kworker.0 00000100:00100000:0.0:1783946764.177208:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522982272:0@lo:400:kworker.0 00000100:00100000:1.0:1783946764.177415:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522982400:0@lo:400:kworker.0 00000100:00100000:1.0:1783946764.177451:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946764.177484:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783946764.177490:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522982016:0@lo:400:kworker.0 00000100:00100000:1.0:1783946764.177518:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946764.177546:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522982528:0@lo:400:kworker.0 00000100:00100000:1.0:1783946764.177570:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946764.177599:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522982016 00000100:00100000:1.0:1783946764.177603:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522982016 00000100:00100000:1.0:1783946764.177632:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783946764.177639:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522982016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946764.177683:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522982016:12345-0@lo:400:kworker.0 Request processed in 45us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946764.177689:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783946764.177723:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522982016:0@lo:400:kworker.0 00000100:00100000:2.0:1783946764.177788:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522982400 00000100:00100000:2.0:1783946764.177792:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522982400 00000100:00100000:2.0:1783946764.177831:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783946764.177839:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522982400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946764.177883:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522982400:12345-0@lo:400:kworker.0 Request processed in 46us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946764.177889:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1783946764.177914:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be472300 x1870603522982400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946764.177925:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522982400:0@lo:400:kworker.0 00000100:00100000:0.0:1783946764.181910:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522982528 00000100:00100000:0.0:1783946764.181929:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522982528 00000100:00100000:0.0:1783946764.182030:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783946764.182046:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522982528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946764.182211:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522982528:12345-0@lo:400:kworker.0 Request processed in 169us (4639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946764.182219:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1783946764.182248:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946764.182297:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522982528:0@lo:400:kworker.0 00000100:00100000:1.0:1783946764.184402:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522982784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946764.184493:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946764.184713:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522982784 00000100:00100000:3.0:1783946764.184723:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522982784 00000100:00100000:3.0:1783946764.184802:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783946764.184815:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522982784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783946764.184858:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946764.194493:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522982784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9659us (9979us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946764.194516:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1783946764.198265:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be472d80 x1870603522982784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946764.198308:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522982784:0@lo:13:osp-pre-1-0.0 00000020:00000004:3.0:1783946764.419684:0:11040:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946764.419886:0:11040:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783946764.433197:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946765.459210:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946766.194371:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946766.194515:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946766.196584:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507218432 00000100:00100000:3.0:1783946766.196598:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507218432 00000100:00100000:3.0:1783946766.196702:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:3.0:1783946766.196716:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507218432:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946766.196805:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507218432:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 92us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946766.196813:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00080000:3.0:1783946766.196996:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946766.199581:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507218304 00000100:00100000:0.0:1783946766.199593:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507218304 00000100:00100000:1.0:1783946766.199955:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:1.0:1783946766.199972:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507218304:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946766.200128:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507218304:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 158us (5768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946766.200137:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:0.0:1783946766.201642:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946766.201862:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507218688 00000100:00100000:1.0:1783946766.201874:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507218688 00000100:00100000:1.0:1783946766.201948:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:1.0:1783946766.201960:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2360:x1870603507218688:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:1.0:1783946766.201996:0:9002:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7334 00000100:00080000:1.0:1783946766.202006:0:9002:0:(import.c:65:import_set_state_nolock()) ffff9137b65dd800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783946766.202032:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783946766.202054:0:9002:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1783946766.202079:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946766.202506:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d5851e04-311c-4929-a2c6-87673cd4c005+2:2360:x1870603507218688:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 548us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946766.202516:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1783946766.210163:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946766.212722:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946766.212863:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507218560 00000100:00100000:2.0:1783946766.212875:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507218560 00000100:00100000:2.0:1783946766.212950:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:2.0:1783946766.212961:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507218560:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946766.213045:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507218560:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 85us (2893us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946766.213052:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00080000:2.0:1783946766.213089:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946766.225845:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507218816 00000100:00100000:1.0:1783946766.225861:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507218816 00000100:00100000:1.0:1783946766.225970:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:1.0:1783946766.225982:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5851e04-311c-4929-a2c6-87673cd4c005+5:2360:x1870603507218816:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:1.0:1783946766.226017:0:6944:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db733b 00000100:00080000:1.0:1783946766.226029:0:6944:0:(import.c:65:import_set_state_nolock()) ffff9137bdc7d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783946766.226095:0:6944:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783946766.226276:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d5851e04-311c-4929-a2c6-87673cd4c005+2:2360:x1870603507218816:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 296us (13562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946766.226297:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00080000:1.0:1783946766.226338:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783946766.226723:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946766.481024:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783946766.953226:0:11139:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946766.953621:0:11139:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783946767.504252:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946768.272753:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783946768.272785:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522982912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946768.272866:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946768.274200:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522982912 00000100:00100000:1.0:1783946768.274212:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522982912 00000100:00100000:1.0:1783946768.274278:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783946768.274290:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522982912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946768.274331:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946768.274428:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522982912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946768.274435:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1783946768.274458:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783946768.275794:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be3f0000 x1870603522982912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946768.275819:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522982912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783946768.529086:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946769.297925:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946769.297957:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522983040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946769.298052:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946769.306002:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522983040 00000100:00100000:1.0:1783946769.306022:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522983040 00000100:00100000:1.0:1783946769.306215:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783946769.306227:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522983040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946769.306269:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946769.306361:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522983040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (8309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946769.306369:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1783946769.307943:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783946769.308219:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be473b80 x1870603522983040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946769.308242:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522983040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946769.309273:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522983552:0@lo:400:kworker.0 00000100:00100000:2.0:1783946769.309341:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946769.309385:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783946769.309391:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522983424:0@lo:400:kworker.0 00000100:00100000:2.0:1783946769.309417:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946769.309464:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522983552 00000100:00100000:2.0:1783946769.309480:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522983552 00000100:00100000:2.0:1783946769.309528:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783946769.309537:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522983552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.310308:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522983296:0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.310355:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946769.310385:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783946769.310392:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522983168:0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.310421:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946769.310447:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522983680:0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.310470:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946769.310751:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522983168 00000100:00100000:0.0:1783946769.310759:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522983168 00000100:00100000:0.0:1783946769.310812:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783946769.310820:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522983168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.310865:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522983168:12345-0@lo:400:kworker.0 Request processed in 45us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946769.310873:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783946769.310923:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522983168:0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.314989:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522983424 00000100:00100000:0.0:1783946769.315023:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522983424 00000100:00100000:0.0:1783946769.315122:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522983296 00000100:00100000:0.0:1783946769.315126:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522983296 00000100:00100000:0.0:1783946769.315144:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522983680 00000100:00100000:0.0:1783946769.315148:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522983680 00000100:00100000:0.0:1783946769.315166:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783946769.315176:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522983424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.315269:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522983424:12345-0@lo:400:kworker.0 Request processed in 94us (5850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946769.315276:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783946769.315293:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783946769.315300:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522983296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.315335:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522983296:12345-0@lo:400:kworker.0 Request processed in 36us (4980us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946769.315341:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783946769.315352:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783946769.315358:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522983680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.315385:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522983680:12345-0@lo:400:kworker.0 Request processed in 28us (4915us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946769.315390:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783946769.315441:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522983680:0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.315456:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522983296:0@lo:400:kworker.0 00000100:00100000:0.0:1783946769.315495:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522983424:0@lo:400:kworker.0 00000100:00080000:1.0:1783946769.315546:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946769.316483:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522983552:12345-0@lo:400:kworker.0 Request processed in 6942us (7137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946769.316495:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1783946769.325795:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23f100 x1870603522983552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946769.325828:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522983552:0@lo:400:kworker.0 00000020:00000004:2.0:1783946769.421440:0:11236:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783946769.426779:0:11236:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783946769.554770:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946770.577222:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946771.319841:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946771.319906:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946771.320005:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946771.320107:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507218944 00000100:00100000:2.0:1783946771.320120:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507218944 00000100:00100000:2.0:1783946771.320217:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 234 00000100:00100000:2.0:1783946771.320231:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507218944:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946771.320370:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507218944:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 141us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946771.320379:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 234 00000100:00100000:0.0:1783946771.321294:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507219200 00000100:00100000:0.0:1783946771.321307:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507219200 00000100:00100000:0.0:1783946771.321415:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507219072 00000100:00100000:0.0:1783946771.321420:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507219072 00000100:00100000:3.0:1783946771.321477:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:3.0:1783946771.321491:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507219200:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946771.321656:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507219200:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 167us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946771.321665:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00080000:1.0:1783946771.322357:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946771.322514:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:0.0:1783946771.322526:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507219072:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946771.322615:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507219072:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 91us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946771.322623:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 98 00010000:00010000:0.0:1783946771.607745:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783946771.859261:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d5851e04-311c-4929-a2c6-87673cd4c005 00000020:00000080:2.0:1783946771.859274:0:6938:0:(genops.c:906:class_export_put()) final put ffff9137b65da800/d5851e04-311c-4929-a2c6-87673cd4c005 00000020:00000080:0.0:1783946771.861210:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65da800/d5851e04-311c-4929-a2c6-87673cd4c005 for lustre-OST0000 00000020:00000080:0.0:1783946771.861254:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137b65dd800 for lustre-OST0000 00000001:00100000:0.0:1783946771.865820:0:8015:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d5851e04-311c-4929-a2c6-87673cd4c005 00000020:00000080:0.0:1783946771.865831:0:8015:0:(genops.c:906:class_export_put()) final put ffff9137b65df800/d5851e04-311c-4929-a2c6-87673cd4c005 00000020:00000080:1.0:1783946771.865899:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65df800/d5851e04-311c-4929-a2c6-87673cd4c005 for lustre-OST0001 00000020:00000080:1.0:1783946771.865945:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137bdc7d800 for lustre-OST0001 00010000:00010000:0.0:1783946772.624226:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946773.392478:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522983808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946773.392564:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946773.392802:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522983808 00000100:00100000:1.0:1783946773.392811:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522983808 00000100:00100000:1.0:1783946773.392891:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783946773.392902:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522983808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946773.392946:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946773.393041:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522983808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946773.393050:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1783946773.393052:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783946773.393168:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be3f3480 x1870603522983808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946773.393189:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522983808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783946773.650213:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783946773.760802:0:11381:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1783946774.416642:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522984320:0@lo:400:kworker.0 00000100:00100000:0.0:1783946774.416735:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946774.416796:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783946774.416803:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522984192:0@lo:400:kworker.0 00000100:00100000:0.0:1783946774.416842:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946774.416935:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522984064:0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.416965:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946774.416990:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522984576:0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417010:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946774.417027:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783946774.417032:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522983936:0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417083:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946774.417107:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522984448:0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417161:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946774.417190:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522984192 00000100:00100000:3.0:1783946774.417197:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522984192 00000100:00100000:3.0:1783946774.417246:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522984064 00000100:00100000:3.0:1783946774.417250:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522984064 00000100:00100000:3.0:1783946774.417262:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522984448 00000100:00100000:3.0:1783946774.417275:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522984448 00000100:00100000:3.0:1783946774.417293:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783946774.417302:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522984192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417360:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522984192:12345-0@lo:400:kworker.0 Request processed in 57us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946774.417375:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783946774.417398:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783946774.417403:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522984064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417436:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522984064:12345-0@lo:400:kworker.0 Request processed in 33us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946774.417442:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783946774.417454:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783946774.417460:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522984448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417497:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522984448:12345-0@lo:400:kworker.0 Request processed in 37us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946774.417503:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783946774.417523:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522983936 00000100:00100000:3.0:1783946774.417526:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522983936 00000100:00100000:3.0:1783946774.417554:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783946774.417561:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522983936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417589:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522983936:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946774.417595:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:3.0:1783946774.417626:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946774.417658:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522983936:0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417670:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522984448:0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417678:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522984064:0@lo:400:kworker.0 00000100:00100000:3.0:1783946774.417708:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522984192:0@lo:400:kworker.0 00000100:00100000:1.0:1783946774.418177:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522984320 00000100:00100000:1.0:1783946774.418182:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522984320 00000100:00100000:1.0:1783946774.418218:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522984576 00000100:00100000:1.0:1783946774.418221:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522984576 00000100:00100000:1.0:1783946774.418249:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783946774.418256:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522984320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946774.418389:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522984320:12345-0@lo:400:kworker.0 Request processed in 134us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946774.418401:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783946774.418418:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783946774.418424:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522984576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946774.418457:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522984576:12345-0@lo:400:kworker.0 Request processed in 34us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946774.418463:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1783946774.418489:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783946774.418510:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b65a8380 x1870603522984576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946774.418521:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522984576:0@lo:400:kworker.0 00000100:00100000:2.0:1783946774.418624:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522984704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946774.418701:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783946774.418711:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23d500 x1870603522984320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946774.418721:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522984320:0@lo:400:kworker.0 00000100:00100000:1.0:1783946774.418871:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522984704 00000100:00100000:1.0:1783946774.418876:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522984704 00000100:00100000:1.0:1783946774.418946:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783946774.418954:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522984704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946774.418989:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946774.419037:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522984704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946774.419043:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1783946774.419104:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be3f2300 x1870603522984704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946774.419138:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522984704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783946774.673110:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946775.696218:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946776.440228:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946776.442561:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946776.443455:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507219456 00000100:00100000:1.0:1783946776.443470:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507219456 00000100:00100000:1.0:1783946776.443551:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:1.0:1783946776.443563:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507219456:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:2.0:1783946776.443609:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946776.443660:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507219456:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 99us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946776.443669:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:0.0:1783946776.445300:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507219328 00000100:00100000:0.0:1783946776.445313:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507219328 00000100:00100000:2.0:1783946776.445461:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 236 00000100:00100000:2.0:1783946776.445473:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507219328:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946776.445555:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507219328:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 84us (5336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946776.445564:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 236 00000100:00100000:3.0:1783946776.449055:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946776.449612:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507219584 00000100:00100000:0.0:1783946776.449623:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507219584 00000100:00100000:0.0:1783946776.449702:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:0.0:1783946776.449714:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507219584:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946776.449799:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507219584:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 87us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946776.449807:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00080000:1.0:1783946776.450122:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783946776.723404:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783946777.732031:0:11528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe84ab3c00 20000000:00000080:2.0:1783946777.732107:0:11528:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9137be36f800 uarg=0000000000000000 20000000:01000000:2.0:1783946777.732157:0:11528:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783946777.732164:0:11528:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783946777.732169:0:11528:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783946777.733935:0:11529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1783946777.738541:0:11528:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 00010000:00010000:0.0:1783946777.744224:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783946777.747161:0:11528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783946777.747688:0:11528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.747710:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db72e7 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.747718:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db72f5 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.747725:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7303 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.747734:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571dbf expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.747741:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571df7 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.747748:0:11528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.747813:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571df7 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.747830:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571df7 expref: 12 pid: 5949 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946777.747846:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522984832:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946777.747983:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571dbf expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.748011:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571dbf expref: 12 pid: 5950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946777.748021:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522984960:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946777.748053:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7303 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.748094:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7303 expref: 18 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946777.748103:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522985088:0@lo:104: 00000100:00100000:2.0:1783946777.748142:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783946777.748202:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db72f5 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.748210:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db72f5 expref: 18 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946777.748218:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522985216:0@lo:104: 00000100:00100000:2.0:1783946777.748239:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783946777.748266:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db72e7 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.748273:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db72e7 expref: 18 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946777.748280:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522985344:0@lo:104: 00000100:00100000:2.0:1783946777.748299:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946777.748316:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787fcd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946777.748501:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522985088 00000100:00100000:1.0:1783946777.748509:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522985088 00000100:00100000:1.0:1783946777.748570:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522985216 00000100:00100000:1.0:1783946777.748573:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522985216 00000100:00100000:1.0:1783946777.748583:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522985344 00000100:00100000:1.0:1783946777.748586:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522985344 00000100:00100000:1.0:1783946777.748600:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783946777.748609:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:11528:x1870603522985088:12345-0@lo:104: 00010000:00010000:1.0:1783946777.748622:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748672:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783946777.748678:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+5:11528:x1870603522985088:12345-0@lo:104: Request processed in 71us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946777.748685:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783946777.748709:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783946777.748714:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:11528:x1870603522985216:12345-0@lo:104: 00010000:00010000:1.0:1783946777.748722:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748754:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783946777.748758:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:11528:x1870603522985216:12345-0@lo:104: Request processed in 44us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946777.748764:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783946777.748775:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783946777.748780:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:11528:x1870603522985344:12345-0@lo:104: 00010000:00010000:1.0:1783946777.748786:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748811:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783946777.748816:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:11528:x1870603522985344:12345-0@lo:104: Request processed in 36us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946777.748821:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783946777.748836:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783946777.748842:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748849:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45800 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946777.748852:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748860:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946777.748878:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946777.748884:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783946777.748911:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748919:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946777.748940:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748947:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137b9f45800/0x229d2ec450db7303 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db730a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748961:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783946777.748964:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748970:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bee00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946777.748973:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.748979:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946777.748985:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946777.748990:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783946777.749009:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749015:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946777.749031:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749037:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35bee00/0x229d2ec450db72f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db72fc expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749046:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946777.749049:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749054:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622400 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946777.749078:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749086:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946777.749092:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946777.749097:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783946777.749108:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749113:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946777.749119:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749135:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797622400/0x229d2ec450db72e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db72ee expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749147:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946777.749149:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946777.749150:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946777.749161:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522985472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783946777.749194:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946777.749260:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522985600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783946777.749297:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946777.749316:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783946777.749322:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522985728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783946777.749340:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946777.749367:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522985472 00000100:00100000:1.0:1783946777.749371:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522985472 00010000:00010000:1.0:1783946777.749388:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7303 expref: 19 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946777.749408:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522985600 00000100:00100000:1.0:1783946777.749411:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522985600 00010000:00010000:1.0:1783946777.749432:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db72f5 expref: 20 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946777.749444:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522985728 00000100:00100000:1.0:1783946777.749446:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522985728 00010000:00010000:1.0:1783946777.749457:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db72e7 expref: 21 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946777.749482:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783946777.749488:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3531c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+21:3448:x1870603522985472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783946777.749498:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946777.749503:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7303 expref: 21 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749511:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7303 expref: 21 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749525:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946777.749554:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3531c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+21:3448:x1870603522985472:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946777.749560:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783946777.749596:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783946777.749602:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+20:3449:x1870603522985600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783946777.749609:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946777.749613:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db72f5 expref: 20 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749621:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db72f5 expref: 20 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749630:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946777.749654:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+20:3449:x1870603522985600:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946777.749659:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783946777.749670:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783946777.749682:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522985728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783946777.749689:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946777.749693:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db72e7 expref: 19 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749700:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db72e7 expref: 19 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.749708:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946777.749729:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522985728:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946777.749734:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1783946777.749759:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946777.749784:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522985472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783946777.749805:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522985728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783946777.749812:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522985600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783946777.750797:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f44800/0x229d2ec450db730a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7303 expref: 18 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946777.750825:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522985088:0@lo:104: 00010000:00010000:2.0:1783946777.750836:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bfe00/0x229d2ec450db72fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db72f5 expref: 17 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946777.750843:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522985216:0@lo:104: 00010000:00010000:2.0:1783946777.750852:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35be000/0x229d2ec450db72ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db72e7 expref: 16 pid: 5949 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946777.750859:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522985344:0@lo:104: 00000100:00100000:3.0:1783946777.771525:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946777.771651:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507219712 00000100:00100000:1.0:1783946777.771661:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507219712 00010000:00010000:1.0:1783946777.771697:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571df7 expref: 13 pid: 5949 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946777.771735:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:1.0:1783946777.771743:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507219712:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946777.771756:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946777.771762:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571df7 expref: 13 pid: 5949 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.771792:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571df7 expref: 13 pid: 5949 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.771822:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946777.771868:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507219712:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 126us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946777.771876:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00010000:00010000:0.0:1783946777.772243:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35be400/0x229d2ec450db7326 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571df7 expref: 12 pid: 5949 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946777.772259:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522984832:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946777.784482:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946777.784636:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507219840 00000100:00100000:1.0:1783946777.784645:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507219840 00010000:00010000:1.0:1783946777.784688:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571dbf expref: 12 pid: 5950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946777.784732:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:1.0:1783946777.784741:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:2362:x1870603507219840:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946777.784756:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946777.784762:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571dbf expref: 12 pid: 5950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784773:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571dbf expref: 12 pid: 5950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784794:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784817:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784835:0:8023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784855:0:8023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784862:0:8023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784869:0:8023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784875:0:8023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946777.784880:0:8023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784887:0:8023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784896:0:8023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946777.784905:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946777.784958:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:2362:x1870603507219840:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 218us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946777.784966:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00010000:00010000:2.0:1783946777.785502:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797623400/0x229d2ec450db7311 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571dbf expref: 11 pid: 5950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946777.785520:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1870603522984960:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946777.785554:0:11528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.785563:0:11528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.785569:0:11528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946777.785574:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622600/0x229d2ec450db7342 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946778.512816:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522985856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946778.512925:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946778.513101:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522985856 00000100:00100000:0.0:1783946778.513111:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522985856 00000100:00100000:0.0:1783946778.513181:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783946778.513190:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522985856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946778.513218:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946778.513270:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522985856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946778.513276:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1783946778.513398:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783946778.513514:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be3f1f80 x1870603522985856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946778.513532:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522985856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783946778.769751:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946779.191216:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946779.191680:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507219968 00000100:00100000:0.0:1783946779.191694:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507219968 00000100:00100000:0.0:1783946779.191782:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 237 00000100:00100000:0.0:1783946779.191795:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:5452:x1870603507219968:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946779.191818:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946779.191847:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571e21 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946779.191897:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e21 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946779.191910:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e21 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946779.191922:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf800, rc 0) 00000100:00100000:0.0:1783946779.192002:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507219968:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 210us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946779.192010:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 237 00000100:00100000:0.0:1783946779.207194:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946779.207357:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507220096 00000100:00100000:1.0:1783946779.207369:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507220096 00000100:00100000:1.0:1783946779.207465:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 238 00000100:00100000:1.0:1783946779.207478:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507220096:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783946779.207684:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507220096:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 208us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946779.207693:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 238 00000100:00100000:1.0:1783946779.212226:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946779.212356:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507220224 00000100:00100000:2.0:1783946779.212367:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507220224 00000100:00100000:2.0:1783946779.212450:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 239 00000100:00100000:2.0:1783946779.212460:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507220224:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946779.212624:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507220224:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 165us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946779.212640:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 239 00000100:00100000:0.0:1783946779.226675:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946779.226806:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507220352 00000100:00100000:1.0:1783946779.226816:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507220352 00000100:00100000:1.0:1783946779.226894:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 240 00000100:00100000:1.0:1783946779.226906:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507220352:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783946779.226925:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946779.226953:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571e28 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946779.226984:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e28 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946779.226997:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e28 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946779.227007:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44600, rc 0) 00000100:00100000:1.0:1783946779.227138:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507220352:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 234us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946779.227146:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 240 00000100:00100000:0.0:1783946779.234196:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946779.234437:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507220480 00000100:00100000:2.0:1783946779.234447:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507220480 00000100:00100000:2.0:1783946779.234507:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 241 00000100:00100000:2.0:1783946779.234517:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507220480:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946779.234671:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507220480:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 155us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946779.234679:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 241 00000100:00100000:3.0:1783946779.241270:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946779.241341:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507220608 00000100:00100000:0.0:1783946779.241352:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507220608 00000100:00100000:0.0:1783946779.241418:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 242 00000100:00100000:0.0:1783946779.241429:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507220608:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946779.241574:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507220608:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 146us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946779.241584:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 242 10000000:01000000:0.0:1783946779.480923:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783946779.480932:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137a7c0f800 from 7 10000000:01000000:0.0:1783946779.480937:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783946779.480987:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946779.480999:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946779.481008:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946779.481034:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522985984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783946779.481115:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946779.481176:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be39bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783946779.482445:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522985984 00000100:00100000:2.0:1783946779.482453:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522985984 00000100:00100000:2.0:1783946779.482509:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783946779.482519:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522985984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946779.482534:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946779.482554:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7357 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946779.482605:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7357 expref: 17 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946779.482619:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7357 expref: 17 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946779.482629:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622000, rc 0) 00000100:00100000:2.0:1783946779.482708:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522985984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946779.482716:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783946779.482936:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522985984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783946779.482953:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.482963:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946779.483033:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946779.483083:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946779.483114:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783946779.483516:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522986112 00000100:00100000:2.0:1783946779.483522:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522986112 00000100:00100000:2.0:1783946779.483557:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1783946779.483564:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522986112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946779.483666:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522986112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946779.483672:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783946779.484085:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946779.484117:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946779.484241:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946779.484263:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f35d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783946779.484275:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522986240 00000100:00100000:3.0:1783946779.484280:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522986240 00000100:00100000:3.0:1783946779.484304:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1783946779.484311:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522986240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946779.484418:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522986240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946779.484425:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1783946779.484468:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783946779.488451:0:11548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783946779.488549:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783946779.488575:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783946779.488586:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.488597:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946779.488607:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783946779.488609:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137b63de800 from 7 10000000:01000000:3.0:1783946779.488612:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783946779.488648:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.488655:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.488665:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946779.488690:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783946779.488747:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946779.488779:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f35840 going to sleep for 11 seconds 00000100:00100000:3.0:1783946779.490319:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522986368 00000100:00100000:3.0:1783946779.490327:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522986368 00000100:00100000:3.0:1783946779.490387:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1783946779.490407:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522986368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783946779.490423:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946779.490438:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7365 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.490464:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7365 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.490475:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7365 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.490484:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151bc00, rc 0) 00000100:00100000:3.0:1783946779.490541:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522986368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946779.490547:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1783946779.490567:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946779.490584:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946779.490594:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946779.490660:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946779.490691:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946779.490732:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787fcd840 going to sleep for 11 seconds 00000100:00100000:3.0:1783946779.492434:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522986496 00000100:00100000:3.0:1783946779.492446:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522986496 00000100:00100000:3.0:1783946779.492505:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783946779.492514:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522986496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946779.492656:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522986496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946779.492664:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783946779.492709:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946779.492763:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946779.495032:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946779.495108:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f35e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783946779.495953:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522986624 00000100:00100000:2.0:1783946779.495963:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522986624 00000100:00100000:2.0:1783946779.496012:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1783946779.496022:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522986624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946779.496161:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522986624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946779.496437:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1783946779.496577:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783946779.499632:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783946779.500082:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783946779.500107:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783946779.500120:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.500147:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946779.500159:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783946779.500162:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff913786178000 from 7 10000000:01000000:3.0:1783946779.500851:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783946779.500899:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.500910:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946779.500920:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946779.500947:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783946779.501018:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946779.504431:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f35e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783946779.521906:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522986752 00000100:00100000:0.0:1783946779.521921:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522986752 00000100:00100000:1.0:1783946779.522050:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1783946779.522076:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522986752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783946779.522095:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946779.522115:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db7373 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946779.522160:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db7373 expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946779.522173:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7373 expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946779.522182:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44e00, rc 0) 00000100:00100000:1.0:1783946779.522283:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522986752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (21264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946779.522290:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783946779.522614:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946779.522634:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946779.522644:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946779.522721:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946779.522778:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946779.522817:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be39b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946779.522898:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522986880 00000100:00100000:2.0:1783946779.522904:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522986880 00000100:00100000:2.0:1783946779.522939:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1783946779.522947:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522986880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946779.523093:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522986880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946779.523101:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783946779.523137:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522986880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946779.523177:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522987008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946779.523217:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946779.523237:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be39b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946779.523374:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522987008 00000100:00100000:1.0:1783946779.523379:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522987008 00000100:00100000:1.0:1783946779.523421:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1783946779.523427:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522987008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783946779.523506:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522987008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946779.523512:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783946779.523836:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522987008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783946779.529955:0:11552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783946779.530083:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783946779.530115:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783946779.530127:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946779.530138:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946779.542639:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522987520:0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.542718:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946779.542772:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783946779.542778:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522987136:0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.542800:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946779.542818:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522987648:0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.542840:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946779.542865:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522987264:0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.542887:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946779.542903:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946779.542909:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522987392:0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.542928:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946779.542958:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522987520 00000100:00100000:0.0:1783946779.542965:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522987520 00000100:00100000:0.0:1783946779.543014:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522987136 00000100:00100000:0.0:1783946779.543018:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522987136 00000100:00100000:0.0:1783946779.543030:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522987264 00000100:00100000:0.0:1783946779.543039:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522987264 00000100:00100000:0.0:1783946779.543074:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783946779.543084:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522987520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.543137:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522987520:12345-0@lo:400:kworker.0 Request processed in 54us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946779.543145:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783946779.543162:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783946779.543167:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522987136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.543192:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522987136:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946779.543198:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783946779.543206:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783946779.543212:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522987264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.543240:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522987264:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946779.543245:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783946779.543265:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522987648 00000100:00100000:0.0:1783946779.543269:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522987648 00000100:00100000:0.0:1783946779.543292:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522987392 00000100:00100000:0.0:1783946779.543295:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522987392 00000100:00100000:0.0:1783946779.543309:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783946779.543315:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522987648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.543347:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522987648:12345-0@lo:400:kworker.0 Request processed in 32us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946779.543353:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783946779.543364:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783946779.543369:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522987392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.543417:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522987392:12345-0@lo:400:kworker.0 Request processed in 48us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946779.543424:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1783946779.543446:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783946779.543452:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946779.543487:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522987136:0@lo:400:kworker.0 00010000:00080000:0.0:1783946779.543499:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b9ce6300 x1870603522987648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946779.543525:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522987648:0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.543535:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522987520:0@lo:400:kworker.0 00010000:00080000:0.0:1783946779.543559:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b9ce7480 x1870603522987392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946779.543567:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522987392:0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.543574:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522987264:0@lo:400:kworker.0 00000100:00100000:0.0:1783946779.544325:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783946779.544336:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522987776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946779.544368:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946779.544409:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522987776 00000100:00100000:0.0:1783946779.544414:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522987776 00000100:00100000:0.0:1783946779.544443:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783946779.544450:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522987776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783946779.544471:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946779.544501:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522987776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946779.544515:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1783946779.544541:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bde8dc00 x1870603522987776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946779.544556:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522987776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783946779.794529:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946780.816232:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946781.553607:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946781.553647:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946781.553675:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946781.553703:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507220864 00000100:00100000:1.0:1783946781.553712:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507220864 00000100:00100000:1.0:1783946781.553768:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507220992 00000100:00100000:1.0:1783946781.553771:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507220992 00000100:00100000:1.0:1783946781.553799:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:1.0:1783946781.553809:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507220864:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946781.553884:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507220864:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 76us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946781.553899:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:1.0:1783946781.553916:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 108 00000100:00100000:1.0:1783946781.553923:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507220992:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946781.553951:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507220992:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946781.553958:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 108 00000100:00080000:1.0:1783946781.553974:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946781.554142:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507220736 00000100:00100000:3.0:1783946781.554147:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507220736 00000100:00100000:3.0:1783946781.554186:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 252 00000100:00100000:3.0:1783946781.554194:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507220736:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946781.554223:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507220736:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946781.554231:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 252 00010000:00010000:2.0:1783946781.860739:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946782.867925:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946783.634300:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783946783.634335:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522987904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946783.634450:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946783.634513:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522987904 00000100:00100000:1.0:1783946783.634520:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522987904 00000100:00100000:1.0:1783946783.634591:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783946783.634600:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522987904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946783.634628:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946783.634671:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522987904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946783.634678:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1783946783.634699:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783946783.634729:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be3f1f80 x1870603522987904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946783.634748:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522987904:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1783946783.773803:0:11726:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783946783.888622:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946784.657290:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946784.657346:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522988032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946784.657446:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946784.657674:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522988032 00000100:00100000:0.0:1783946784.657684:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522988032 00000100:00100000:0.0:1783946784.657762:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783946784.657775:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522988032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783946784.657828:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946784.657883:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522988032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946784.657892:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1783946784.658010:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783946784.658375:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b9ce7480 x1870603522988032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946784.658397:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522988032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946784.658607:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522988416:0@lo:400:kworker.0 00000100:00100000:3.0:1783946784.658644:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946784.658671:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783946784.658677:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522988288:0@lo:400:kworker.0 00000100:00100000:3.0:1783946784.658723:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946784.658822:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522988416 00000100:00100000:1.0:1783946784.658828:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522988416 00000100:00100000:1.0:1783946784.658884:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522988288 00000100:00100000:1.0:1783946784.658888:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522988288 00000100:00100000:1.0:1783946784.658908:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783946784.658916:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522988416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.658970:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522988416:12345-0@lo:400:kworker.0 Request processed in 54us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946784.658977:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783946784.658991:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783946784.658998:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522988288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659024:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522988288:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946784.659030:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783946784.659111:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522988544:0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659140:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946784.659162:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783946784.659168:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522988160:0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659197:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946784.659219:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522988672:0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659290:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946784.659326:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522988544 00000100:00100000:1.0:1783946784.659330:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522988544 00000100:00100000:1.0:1783946784.659359:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783946784.659365:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522988544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659401:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522988544:12345-0@lo:400:kworker.0 Request processed in 36us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946784.659408:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783946784.659432:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522988160 00000100:00100000:1.0:1783946784.659436:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522988160 00000100:00100000:1.0:1783946784.659461:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783946784.659468:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522988160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659498:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522988160:12345-0@lo:400:kworker.0 Request processed in 30us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946784.659504:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783946784.659664:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522988288:0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659675:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522988416:0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659706:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522988672 00000100:00100000:1.0:1783946784.659710:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522988672 00000100:00100000:1.0:1783946784.659736:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783946784.659742:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522988672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659774:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522988672:12345-0@lo:400:kworker.0 Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946784.659780:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783946784.659806:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522988160:0@lo:400:kworker.0 00000100:00100000:1.0:1783946784.659817:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522988672:0@lo:400:kworker.0 00010000:00080000:1.0:1783946784.659829:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23f100 x1870603522988544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946784.659841:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522988544:0@lo:400:kworker.0 00000100:00080000:3.0:1783946784.664086:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783946784.912802:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946785.950508:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946786.676223:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946786.676281:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946786.680669:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507221120 00000100:00100000:3.0:1783946786.680689:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507221120 00000100:00100000:3.0:1783946786.680989:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 254 00000100:00100000:3.0:1783946786.681002:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507221120:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946786.681181:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507221120:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 181us (4967us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946786.681190:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 254 00000100:00100000:3.0:1783946786.681529:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946786.681623:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507221376 00000100:00100000:3.0:1783946786.681629:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507221376 00000100:00100000:3.0:1783946786.681668:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507221248 00000100:00100000:3.0:1783946786.681672:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507221248 00000100:00100000:3.0:1783946786.681692:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:3.0:1783946786.681699:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507221376:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946786.681901:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507221376:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 201us (5618us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946786.681909:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:3.0:1783946786.681924:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:3.0:1783946786.681931:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507221248:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946786.681956:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507221248:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946786.681962:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00080000:3.0:1783946786.681979:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783946786.960410:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946787.984447:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946788.755748:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522988800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946788.756040:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946788.757421:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522988800 00000100:00100000:2.0:1783946788.757440:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522988800 00000100:00080000:0.0:1783946788.757528:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946788.757563:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783946788.757578:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522988800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783946788.757759:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946788.758172:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522988800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 596us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946788.758183:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1783946788.758183:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be4c9180 x1870603522988800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946788.758211:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522988800:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783946789.008495:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946789.776709:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946789.776736:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522988928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946789.776815:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946789.776947:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522988928 00000100:00100000:1.0:1783946789.776955:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522988928 00000100:00100000:1.0:1783946789.777046:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783946789.777098:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522988928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946789.777141:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946789.777191:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522988928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946789.777199:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783946789.777695:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137b9ce4000 x1870603522988928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946789.777716:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522988928:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783946789.777879:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946789.779900:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522989056:0@lo:400:kworker.0 00000100:00100000:1.0:1783946789.780175:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946789.780259:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522989568:0@lo:400:kworker.0 00000100:00100000:1.0:1783946789.780293:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946789.780318:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946789.780324:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522989184:0@lo:400:kworker.0 00000100:00100000:1.0:1783946789.780348:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946789.780651:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522989440:0@lo:400:kworker.0 00000100:00100000:3.0:1783946789.780686:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946789.780719:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783946789.780724:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522989312:0@lo:400:kworker.0 00000100:00100000:3.0:1783946789.780744:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946789.780873:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522989056 00000100:00100000:0.0:1783946789.780883:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522989056 00000100:00100000:0.0:1783946789.780939:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783946789.780950:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522989056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946789.781350:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522989056:12345-0@lo:400:kworker.0 Request processed in 401us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946789.781359:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783946789.781595:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522989568 00000100:00100000:2.0:1783946789.781600:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522989568 00000100:00100000:2.0:1783946789.781639:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522989184 00000100:00100000:2.0:1783946789.781643:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522989184 00000100:00100000:2.0:1783946789.781656:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522989312 00000100:00100000:2.0:1783946789.781667:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522989312 00000100:00100000:2.0:1783946789.781690:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783946789.781697:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522989568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946789.781734:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603522989568:12345-0@lo:400:kworker.0 Request processed in 38us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946789.781740:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783946789.781752:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783946789.781770:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522989184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946789.781798:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522989184:12345-0@lo:400:kworker.0 Request processed in 41us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946789.781804:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783946789.781815:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783946789.781821:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522989312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946789.781848:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522989312:12345-0@lo:400:kworker.0 Request processed in 27us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946789.782485:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1783946789.782556:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946789.782582:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522989312:0@lo:400:kworker.0 00000100:00100000:0.0:1783946789.782942:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522989184:0@lo:400:kworker.0 00000100:00100000:0.0:1783946789.782955:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522989056:0@lo:400:kworker.0 00000100:00100000:0.0:1783946789.782967:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603522989568:0@lo:400:kworker.0 00000100:00100000:1.0:1783946789.790890:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522989440 00000100:00100000:1.0:1783946789.790984:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522989440 00000100:00100000:1.0:1783946789.791145:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783946789.791158:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522989440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946789.791293:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522989440:12345-0@lo:400:kworker.0 Request processed in 137us (10604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946789.791301:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1783946789.791413:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137bdee6d80 x1870603522989440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946789.791430:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522989440:0@lo:400:kworker.0 00010000:00010000:3.0:1783946790.032536:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783946790.910762:0:11875:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:46:29 (1783946789) === 00010000:00010000:3.0:1783946791.057316:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946791.072848:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946791.072894:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946791.073139:0:5965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507221632 00000100:00100000:0.0:1783946791.073149:0:5965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507221632 00000100:00100000:0.0:1783946791.073216:0:5965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1783946791.073238:0:5965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:9641:x1870603507221632:12345-192.168.201.18@tcp:700:mkdir.0 00000100:00100000:0.0:1783946791.073318:0:5965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:9641:x1870603507221632:12345-192.168.201.18@tcp:700:mkdir.0 Request processed in 92us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946791.073327:0:5965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:3.0:1783946791.073742:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507221504 00000100:00100000:3.0:1783946791.073747:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507221504 00000100:00100000:3.0:1783946791.073785:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:3.0:1783946791.073793:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507221504:12345-192.168.201.18@tcp:41:mkdir.0 00000004:00000024:3.0:1783946791.073843:0:5958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:3.0:1783946791.073900:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507221504:12345-192.168.201.18@tcp:41:mkdir.0 Request processed in 107us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946791.073906:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00080000:2.0:1783946791.077796:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946791.078775:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946791.078909:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507221888 00000100:00100000:2.0:1783946791.078919:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507221888 00000100:00100000:2.0:1783946791.078981:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:2.0:1783946791.078991:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:9641:x1870603507221888:12345-192.168.201.18@tcp:36:mkdir.0 00010000:00010000:2.0:1783946791.079052:0:5956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946791.079148:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7262 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571daa expref: 6 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946791.079179:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10000) 00010000:00010000:2.0:1783946791.079190:0:5956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946791.079445:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946791.079459:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946791.079468:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946791.079493:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946791.079501:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946791.079509:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946791.087471:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783946791.087499:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.087512:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.087520:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.087527:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.087532:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.087539:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.087563:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137894a1200) 00010000:00010000:3.0:1783946791.087567:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.087572:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.087579:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7381 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783946791.087602:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064c578fc reply state 0000000081b82b56 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946791.087623:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783946791.087778:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:9641:x1870603507221888:12345-192.168.201.18@tcp:36:mkdir.0 Request processed in 8784us (9004us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783946791.087787:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00010000:00010000:0.0:1783946791.093091:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.093108:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.093117:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.093123:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946791.093134:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.093142:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.093160:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9137894a1d00) 00010000:00010000:0.0:1783946791.093163:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946791.093167:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.093174:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db7388 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946791.101901:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946791.102248:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507222016 00000100:00100000:3.0:1783946791.102258:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507222016 00000100:00100000:3.0:1783946791.102320:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1783946791.102331:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:9642:x1870603507222016:12345-192.168.201.18@tcp:101:chmod.0 00010000:00010000:3.0:1783946791.102357:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946791.102394:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db738f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e2f expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.102464:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7396 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.102480:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7396 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.102491:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7396 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946791.102535:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783946791.102540:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946791.102575:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7396 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.102601:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db738f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e2f expref: 8 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.102633:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7396 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e2f expref: 7 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.102642:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:3.0:1783946791.102645:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946791.102648:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030800, rc 0) 00000100:00100000:3.0:1783946791.102707:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:9642:x1870603507222016:12345-192.168.201.18@tcp:101:chmod.0 Request processed in 377us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946791.102714:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1783946791.106355:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946791.106404:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507222272 00000100:00100000:3.0:1783946791.106413:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507222272 00000100:00100000:3.0:1783946791.106463:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1783946791.106474:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:9642:x1870603507222272:12345-192.168.201.18@tcp:36:chmod.0 00010000:00010000:3.0:1783946791.106527:0:5957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946791.106554:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7396 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e2f expref: 7 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.106574:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:3.0:1783946791.106586:0:5957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946791.106609:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.106622:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.106631:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783946791.106809:0:5957:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db94fcb7 reply state 00000000a71c4aba transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946791.106819:0:5957:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783946791.106827:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783946791.106915:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:9642:x1870603507222272:12345-192.168.201.18@tcp:36:chmod.0 Request processed in 443us (572us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783946791.106923:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00010000:00010000:1.0:1783946791.109687:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.109705:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.109713:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.109732:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946791.109737:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.109745:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.109763:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10100) 00010000:00010000:1.0:1783946791.109766:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783946791.109772:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.109779:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db739d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946791.156163:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946791.156333:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507222400 00000100:00100000:3.0:1783946791.156346:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507222400 00000100:00100000:3.0:1783946791.156474:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1783946791.156486:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:9643:x1870603507222400:12345-192.168.201.18@tcp:101:chown.0 00010000:00010000:3.0:1783946791.156570:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946791.156595:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db73a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e36 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.156665:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db73ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.156679:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db73ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.156691:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db73ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946791.156734:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783946791.156737:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946791.156772:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db73ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.156814:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db73a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e36 expref: 9 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.156831:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db73ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e36 expref: 8 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.156840:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:3.0:1783946791.156843:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946791.156846:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030200, rc 0) 00000100:00100000:3.0:1783946791.157320:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:9643:x1870603507222400:12345-192.168.201.18@tcp:101:chown.0 Request processed in 835us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946791.157328:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1783946791.166761:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946791.166996:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507222528 00000100:00100000:3.0:1783946791.167007:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507222528 00000100:00100000:3.0:1783946791.167095:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:3.0:1783946791.167106:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:9643:x1870603507222528:12345-192.168.201.18@tcp:101:chown.0 00010000:00010000:3.0:1783946791.167127:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946791.167147:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db73b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e3d expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167226:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167240:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167252:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167279:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167287:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167293:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167380:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db73c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167389:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db73c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167396:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db73c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946791.167435:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783946791.167438:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946791.167457:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db73c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167468:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167474:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167480:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167507:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.167513:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167522:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167534:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:3.0:1783946791.167537:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.167541:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167548:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167562:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167568:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167574:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167579:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.167582:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167588:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167606:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9137bdc10300) 00010000:00010000:3.0:1783946791.167608:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.167611:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167617:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167649:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db73b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e3d expref: 10 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167663:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db73c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e3d expref: 9 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.167670:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10700) 00010000:00010000:3.0:1783946791.167672:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946791.167675:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031200, rc 0) 00000100:00100000:3.0:1783946791.167733:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:9643:x1870603507222528:12345-192.168.201.18@tcp:101:chown.0 Request processed in 628us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946791.167741:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1783946791.174515:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946791.175114:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507222784 00000100:00100000:0.0:1783946791.175127:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507222784 00000100:00100000:0.0:1783946791.175189:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:0.0:1783946791.175211:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:9643:x1870603507222784:12345-192.168.201.18@tcp:36:chown.0 00010000:00010000:0.0:1783946791.175273:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946791.175301:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db73c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e3d expref: 9 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.175322:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10700) 00010000:00010000:0.0:1783946791.175335:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783946791.175382:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.175399:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.175430:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783946791.178741:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1783946791.179150:0:7190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007db02d92 reply state 00000000839e672c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946791.179164:0:7190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783946791.179177:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1783946791.179291:0:7190:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1783946791.179313:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:9643:x1870603507222784:12345-192.168.201.18@tcp:36:chown.0 Request processed in 4100us (4816us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783946791.179322:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00010000:00010000:3.0:1783946791.179455:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.179464:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.179472:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.179490:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.179495:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.179503:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.179520:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137be238b00) 00010000:00010000:3.0:1783946791.179523:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783946791.179528:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.179535:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db73ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946791.205535:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946791.205866:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507222912 00000100:00100000:3.0:1783946791.205877:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507222912 00000100:00100000:3.0:1783946791.205939:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:3.0:1783946791.205950:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:9644:x1870603507222912:12345-192.168.201.18@tcp:101:touch.500 00010000:00010000:3.0:1783946791.205974:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946791.205995:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db73d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e44 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783946791.207282:0:5957:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1236us 00010000:00010000:3.0:1783946791.228371:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228403:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228432:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228450:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228458:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228464:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228566:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db73ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228574:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db73ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228581:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db73ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946791.228613:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783946791.228617:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946791.228654:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db73ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228738:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228745:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228761:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228767:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.228771:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228778:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228790:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:3.0:1783946791.228793:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.228797:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228802:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228813:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228818:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228824:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228829:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.228832:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228847:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228856:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9137bdc10300) 00010000:00010000:3.0:1783946791.228858:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.228861:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228867:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228907:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db73d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e44 expref: 8 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228924:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db73ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e44 expref: 7 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.228932:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:3.0:1783946791.228933:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783946791.228936:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031800, rc 0) 00000100:00100000:3.0:1783946791.229300:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:9644:x1870603507222912:12345-192.168.201.18@tcp:101:touch.500 Request processed in 23350us (23772us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946791.229311:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:0.0:1783946791.232571:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946791.234953:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507223168 00000100:00100000:3.0:1783946791.234968:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507223168 00000100:00100000:3.0:1783946791.235096:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:3.0:1783946791.235108:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:9644:x1870603507223168:12345-192.168.201.18@tcp:101:touch.500 00010000:00010000:3.0:1783946791.235147:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946791.235169:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db73f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e4b expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.235311:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.235327:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.235342:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.235378:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.235385:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.235391:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783946791.236520:0:5958:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1783946791.236780:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236793:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236802:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236851:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236858:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236864:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236871:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.236876:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236884:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236896:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:3.0:1783946791.236899:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.236903:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236910:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db73f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783946791.236924:0:5958:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f1cfbe3 reply state 00000000ba7e0fe6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946791.236932:0:5958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783946791.236969:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db73f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e4b expref: 10 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.236996:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e4b expref: 9 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.237005:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:3.0:1783946791.237007:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946791.237009:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031200, rc 0) 00000100:00100000:3.0:1783946791.237110:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:9644:x1870603507223168:12345-192.168.201.18@tcp:101:touch.500 Request processed in 2003us (4549us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783946791.237120:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:2.0:1783946791.241119:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946791.241204:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507223424 00000100:00100000:1.0:1783946791.241214:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507223424 00000100:00100000:1.0:1783946791.241275:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:1.0:1783946791.241285:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:9644:x1870603507223424:12345-192.168.201.18@tcp:36:touch.500 00010000:00010000:1.0:1783946791.241350:0:5956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946791.241382:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e4b expref: 10 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.241404:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:1.0:1783946791.241432:0:5956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783946791.241489:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.241514:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.241525:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783946791.241629:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000736a2796 reply state 0000000015cad602 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946791.241638:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783946791.242100:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:9644:x1870603507223424:12345-192.168.201.18@tcp:36:touch.500 Request processed in 814us (989us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783946791.242107:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00010000:00010000:3.0:1783946791.242300:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.242310:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.242317:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.242323:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.242327:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.242336:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.242349:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb4997741 (ffff9137bdc10300) 00010000:00010000:3.0:1783946791.242352:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.242357:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.242372:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db73ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.244572:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.244589:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.244596:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.244603:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946791.244607:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.244615:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.244630:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9137979fe400) 00010000:00010000:0.0:1783946791.244646:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946791.244651:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.244658:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7414 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946791.246536:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946791.246765:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507223552 00000100:00100000:0.0:1783946791.246777:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507223552 00000100:00100000:0.0:1783946791.246841:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:0.0:1783946791.246853:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:9644:x1870603507223552:12345-192.168.201.18@tcp:101:touch.500 00010000:00010000:0.0:1783946791.246881:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946791.246911:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db741b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e52 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.246985:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db741b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e52 expref: 10 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.247002:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db741b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e52 expref: 10 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.247022:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9137be238000) 00010000:00010000:0.0:1783946791.247025:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783946791.247029:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf200, rc 0) 00000100:00100000:0.0:1783946791.247133:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:9644:x1870603507223552:12345-192.168.201.18@tcp:101:touch.500 Request processed in 282us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946791.247140:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1783946791.252372:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946791.252643:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507223680 00000100:00100000:2.0:1783946791.252653:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507223680 00000100:00100000:2.0:1783946791.252701:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1783946791.252710:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1870603507223680:12345-192.168.201.18@tcp:8:touch.500 00010000:00080000:2.0:1783946791.252743:0:6944:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:2.0:1783946791.252774:0:6944:0:(genops.c:1406:class_connect()) connect: client c2268401-da9f-4e1e-8a1c-9473caf67cba, cookie 0x229d2ec450db7422 00002000:00100000:2.0:1783946791.252798:0:6944:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c2268401-da9f-4e1e-8a1c-9473caf67cba/ffff9137bdf71000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783946791.252817:0:6944:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783946791.252898:0:6944:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783946791.252928:0:6944:0:(import.c:65:import_set_state_nolock()) ffff9137bdf76000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783946791.253005:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2360:x1870603507223680:12345-192.168.201.18@tcp:8:touch.500 Request processed in 294us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946791.253012:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1783946791.256396:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946791.256494:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507223808 00000100:00100000:1.0:1783946791.256504:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507223808 00000100:00100000:1.0:1783946791.256569:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1783946791.256578:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:0:x1870603507223808:12345-192.168.201.18@tcp:2:touch.500 00000100:00080000:2.0:1783946791.256847:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1783946791.272366:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1783946791.272382:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000100:00100000:1.0:1783946791.272599:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:0:x1870603507223808:12345-192.168.201.18@tcp:2:touch.500 Request processed in 16015us (16206us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783946791.272611:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1783946791.274824:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946791.274923:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507224064 00000100:00100000:0.0:1783946791.274932:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507224064 00000100:00100000:0.0:1783946791.274997:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:0.0:1783946791.275006:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:9644:x1870603507224064:12345-192.168.201.18@tcp:35:touch.500 00000100:00100000:1.0:1783946791.279520:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:9644:x1870603507224064:12345-192.168.201.18@tcp:35:touch.500 Request processed in 4501us (4691us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783946791.279536:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1783946791.294721:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946791.295239:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507224192 00000100:00100000:0.0:1783946791.295250:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507224192 00000100:00100000:0.0:1783946791.295317:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:0.0:1783946791.295328:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:9645:x1870603507224192:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:0.0:1783946791.295367:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946791.295389:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db7429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e59 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.295453:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be400/0x229d2ec450db7430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.295464:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be400/0x229d2ec450db7430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.295472:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be400/0x229d2ec450db7430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946791.295523:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783946791.295527:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946791.295561:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be400/0x229d2ec450db7430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.295584:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db7429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e59 expref: 13 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.295597:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be400/0x229d2ec450db7430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e59 expref: 12 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.295618:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:0.0:1783946791.295621:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783946791.295623:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35be400, rc 0) 00000100:00100000:0.0:1783946791.295906:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:9645:x1870603507224192:12345-192.168.201.18@tcp:101:rm.0 Request processed in 580us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946791.295915:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:0.0:1783946791.299230:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946791.299319:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507224448 00000100:00100000:2.0:1783946791.299329:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507224448 00000100:00100000:2.0:1783946791.299392:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:2.0:1783946791.299403:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:9645:x1870603507224448:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:2.0:1783946791.299425:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946791.299445:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db7437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e60 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946791.299543:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783946791.299674:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db7437 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e60 expref: 14 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946791.299686:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:2.0:1783946791.299689:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946791.299694:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db7437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e60 expref: 14 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946791.299720:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622c00, rc 0) 00000100:00100000:2.0:1783946791.299772:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:9645:x1870603507224448:12345-192.168.201.18@tcp:101:rm.0 Request processed in 371us (552us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1783946791.299779:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:3.0:1783946791.302952:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946791.303149:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507224576 00000100:00100000:1.0:1783946791.303171:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507224576 00000100:00100000:1.0:1783946791.303230:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:1.0:1783946791.303241:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:9645:x1870603507224576:12345-192.168.201.18@tcp:37:rm.0 00000100:00100000:1.0:1783946791.307416:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:9645:x1870603507224576:12345-192.168.201.18@tcp:37:rm.0 Request processed in 4165us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946791.307432:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:0.0:1783946791.310173:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946791.310242:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507224832 00000100:00100000:2.0:1783946791.310251:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507224832 00000100:00100000:2.0:1783946791.310421:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:2.0:1783946791.310435:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3481850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:9645:x1870603507224832:12345-192.168.201.18@tcp:35:rm.0 00000100:00100000:2.0:1783946791.310644:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3481850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:9645:x1870603507224832:12345-192.168.201.18@tcp:35:rm.0 Request processed in 213us (478us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783946791.310652:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1783946791.312865:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946791.313034:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507225088 00000100:00100000:1.0:1783946791.313044:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507225088 00000100:00100000:1.0:1783946791.313116:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:1.0:1783946791.313124:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:9645:x1870603507225088:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:1.0:1783946791.313142:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946791.313159:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7445 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e67 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.313279:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45600/0x229d2ec450db744c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.313294:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45600/0x229d2ec450db744c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.313306:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45600/0x229d2ec450db744c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946791.313316:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783946791.313462:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7445 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e67 expref: 17 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.313474:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45600/0x229d2ec450db744c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e67 expref: 16 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946791.313490:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:1.0:1783946791.313492:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783946791.313494:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45600, rc 0) 00000100:00100000:1.0:1783946791.313544:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:9645:x1870603507225088:12345-192.168.201.18@tcp:101:rm.0 Request processed in 421us (688us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783946791.313552:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:3.0:1783946791.316186:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946791.316507:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507225216 00000100:00100000:2.0:1783946791.316516:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507225216 00000100:00100000:2.0:1783946791.316563:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:2.0:1783946791.316573:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:9645:x1870603507225216:12345-192.168.201.18@tcp:41:rm.0 00000004:00000024:2.0:1783946791.316623:0:5958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847337984 avail 7384293376 00000100:00100000:2.0:1783946791.316760:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:9645:x1870603507225216:12345-192.168.201.18@tcp:41:rm.0 Request processed in 188us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946791.316766:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:0.0:1783946791.318506:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946791.318552:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507225344 00000100:00100000:3.0:1783946791.318560:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507225344 00000100:00100000:3.0:1783946791.318603:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:3.0:1783946791.318612:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:9645:x1870603507225344:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:3.0:1783946791.318630:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946791.318650:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db745a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e6e expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318721:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318736:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318745:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318756:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318760:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318776:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318859:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db746f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318867:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db746f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318875:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db746f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946791.318913:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783946791.318917:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946791.318933:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db746f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318942:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db746f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318949:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318956:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318963:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318969:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.318974:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.318987:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319001:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:3.0:1783946791.319004:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.319008:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319014:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319026:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319032:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319037:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319042:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.319044:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319050:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319056:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb4997741 (ffff9137bdc10300) 00010000:00010000:3.0:1783946791.319104:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.319108:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319124:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7468 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319157:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db745a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e6e expref: 18 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319171:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db746f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e6e expref: 17 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.319178:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9137be238000) 00010000:00010000:3.0:1783946791.319180:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946791.319183:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030600, rc 0) 00000100:00100000:3.0:1783946791.319254:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:9645:x1870603507225344:12345-192.168.201.18@tcp:101:rm.0 Request processed in 643us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946791.319262:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:3.0:1783946791.321880:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946791.322055:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507225600 00000100:00100000:0.0:1783946791.322092:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507225600 00000100:00100000:0.0:1783946791.322141:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:0.0:1783946791.322149:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:9645:x1870603507225600:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:0.0:1783946791.322211:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783946791.322253:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db746f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e6e expref: 17 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322281:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db741b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e52 expref: 16 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322294:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9137be238000) 00010000:00010000:0.0:1783946791.322312:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be400/0x229d2ec450db7430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e59 expref: 15 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322319:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:0.0:1783946791.322333:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783946791.322365:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322375:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322383:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322393:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322397:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322400:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322489:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322493:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322497:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783946791.322707:0:7190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783946791.322717:0:7190:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395241656984ns, next at 396241654517ns, rc = 0 00010000:00010000:0.0:1783946791.322770:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322782:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322787:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322793:0:7190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322797:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322800:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322816:0:7190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783946791.322841:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.322846:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783946791.322846:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322852:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.322853:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.322858:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bee00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946791.322862:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.322867:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946791.322869:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.322870:0:5945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.322877:0:5945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.322886:0:5945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9137be238d00) 00010000:00010000:3.0:1783946791.322893:0:5945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783946791.322898:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.322904:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db748b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.322916:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946791.322918:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946791.322919:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946791.323271:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9137be238d00) 00010000:00010000:0.0:1783946791.323275:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783946791.323278:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.323285:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bee00/0x229d2ec450db7484 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.323304:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.323308:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.323312:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.323315:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946791.323316:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.323320:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.323324:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:0.0:1783946791.323325:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946791.323327:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.323331:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db7476 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783946791.323345:0:7190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085e87195 reply state 000000000b8d6b13 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946791.323396:0:7190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783946791.323501:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:9645:x1870603507225600:12345-192.168.201.18@tcp:36:rm.0 Request processed in 1350us (1634us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783946791.323508:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00010000:00010000:3.0:1783946791.324650:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.324660:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.324673:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.324679:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946791.324683:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.324690:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.324702:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb4997741 (ffff9137be238f00) 00010000:00010000:3.0:1783946791.324705:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946791.324708:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946791.324715:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db747d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb4997741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946791.327945:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946791.328104:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507225856 00000100:00100000:1.0:1783946791.328116:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507225856 00000100:00100000:1.0:1783946791.328174:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:1.0:1783946791.328185:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:9645:x1870603507225856:12345-192.168.201.18@tcp:35:rm.0 00000100:00100000:1.0:1783946791.328789:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:9645:x1870603507225856:12345-192.168.201.18@tcp:35:rm.0 Request processed in 605us (854us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783946791.328795:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:1.0:1783946791.330996:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946791.331045:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507226112 00000100:00100000:0.0:1783946791.331054:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507226112 00000100:00100000:0.0:1783946791.331134:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:0.0:1783946791.331144:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:9645:x1870603507226112:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:0.0:1783946791.331211:0:5956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783946791.331250:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45600/0x229d2ec450db744c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e67 expref: 16 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331271:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db73ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e44 expref: 15 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331282:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:0.0:1783946791.331300:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db73ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e36 expref: 14 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331307:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:0.0:1783946791.331312:0:5956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783946791.331333:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331360:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331370:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331382:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331388:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331394:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331470:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331476:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331481:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946791.331647:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783946791.331659:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331677:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331682:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331691:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946791.331694:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331699:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331705:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9137be238300) 00010000:00010000:0.0:1783946791.331707:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783946791.331709:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331713:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db74a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331725:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331728:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331731:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331734:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946791.331736:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331739:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331750:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be238900) 00010000:00010000:0.0:1783946791.331751:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946791.331753:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.331757:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7492 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783946791.331762:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d2e5479 reply state 00000000cff2a43c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946791.331768:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783946791.331838:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:9645:x1870603507226112:12345-192.168.201.18@tcp:36:rm.0 Request processed in 696us (848us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783946791.331845:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00010000:00010000:0.0:1783946791.333635:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.333646:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.333651:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.333654:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946791.333657:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.333669:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.333698:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9137be238c00) 00010000:00010000:0.0:1783946791.333700:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946791.333702:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946791.333707:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7499 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946791.793546:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946791.793591:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946791.793677:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507226240 00000100:00100000:3.0:1783946791.793687:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507226240 00000100:00100000:3.0:1783946791.793748:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 256 00000100:00100000:3.0:1783946791.793758:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507226240:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946791.793846:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507226240:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 89us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946791.793853:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 256 00000100:00100000:2.0:1783946791.793932:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507226368 00000100:00100000:2.0:1783946791.793936:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507226368 00000100:00100000:2.0:1783946791.793986:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:2.0:1783946791.793992:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2363:x1870603507226368:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946791.794024:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2363:x1870603507226368:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 33us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946791.794044:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00080000:3.0:1783946791.794118:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783946792.081418:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946793.112492:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783946793.873221:0:7312:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397792157877ns, next at 398792154584ns, rc = 0 00000100:00100000:1.0:1783946793.873401:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522989696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946793.873472:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946793.873547:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522989696 00000100:00100000:1.0:1783946793.873554:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522989696 00000100:00100000:1.0:1783946793.873610:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783946793.873619:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522989696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946793.873645:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946793.873702:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522989696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946793.873710:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1783946793.873732:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783946793.873837:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be23d500 x1870603522989696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946793.873857:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522989696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783946794.132869:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946794.897838:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522990208:0@lo:400:kworker.0 00000100:00100000:1.0:1783946794.897905:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946794.897964:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783946794.897969:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522990080:0@lo:400:kworker.0 00000100:00100000:1.0:1783946794.897991:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946794.898409:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522989824:0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.898446:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946794.898469:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522990336:0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.898488:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946794.898501:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783946794.898505:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522989952:0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.898521:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946794.898533:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522990464:0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.898549:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946794.898575:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522990208 00000100:00100000:2.0:1783946794.898581:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522990208 00000100:00100000:2.0:1783946794.898619:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522990464 00000100:00100000:2.0:1783946794.898621:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522990464 00000100:00100000:2.0:1783946794.898646:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783946794.898654:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522990208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.898702:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522990208:12345-0@lo:400:kworker.0 Request processed in 49us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946794.898708:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783946794.898723:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783946794.898728:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522990464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.898752:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522990464:12345-0@lo:400:kworker.0 Request processed in 25us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946794.898758:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783946794.898771:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522989824 00000100:00100000:2.0:1783946794.898781:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522989824 00000100:00100000:2.0:1783946794.898802:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783946794.898807:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522989824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.898832:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522989824:12345-0@lo:400:kworker.0 Request processed in 24us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946794.898837:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783946794.898858:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522990080 00000100:00100000:2.0:1783946794.898860:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522990080 00000100:00100000:2.0:1783946794.898881:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522990336 00000100:00100000:2.0:1783946794.898883:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522990336 00000100:00100000:2.0:1783946794.898892:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522989952 00000100:00100000:2.0:1783946794.898894:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522989952 00000100:00100000:2.0:1783946794.898905:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783946794.898910:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522990080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.898933:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522990080:12345-0@lo:400:kworker.0 Request processed in 24us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946794.898939:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783946794.898948:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783946794.898953:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522990336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.898971:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603522990336:12345-0@lo:400:kworker.0 Request processed in 19us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946794.898976:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783946794.898984:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783946794.898989:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522989952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.899007:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603522989952:12345-0@lo:400:kworker.0 Request processed in 18us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946794.899012:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1783946794.899038:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783946794.899041:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783946794.899087:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603522989952:0@lo:400:kworker.0 00010000:00080000:2.0:1783946794.899100:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be49ce00 x1870603522990464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946794.899110:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522990464:0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.899117:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522989824:0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.899125:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603522990336:0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.899175:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522990080:0@lo:400:kworker.0 00010000:00080000:2.0:1783946794.899186:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be3f1f80 x1870603522990208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946794.899194:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522990208:0@lo:400:kworker.0 00000100:00100000:2.0:1783946794.900578:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946794.900601:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522990592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946794.900660:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946794.901574:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522990592 00000100:00100000:1.0:1783946794.901584:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522990592 00000100:00100000:1.0:1783946794.901653:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783946794.901663:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522990592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946794.901696:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946794.901788:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522990592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946794.901796:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1783946794.901927:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be49d500 x1870603522990592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946794.901946:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522990592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783946795.152429:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783946795.527292:0:12023:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1783946796.176317:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783946796.879586:0:12071:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe86de0d70 20000000:00000080:0.0:1783946796.879616:0:12071:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9137bdc83000 uarg=0000000000000000 20000000:01000000:0.0:1783946796.879684:0:12071:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783946796.879694:0:12071:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783946796.879701:0:12071:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1783946796.881049:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1783946796.881702:0:12071:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1783946796.904834:0:12071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1783946796.904962:0:12071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1783946796.904986:0:12071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1783946796.905012:0:12071:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783946796.905042:0:12071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.905090:0:12071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e21 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.905129:0:12071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e28 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.905139:0:12071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7357 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.905147:0:12071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7365 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.905155:0:12071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db7373 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.905165:0:12071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.905225:0:12071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7373 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.905249:0:12071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7373 expref: 18 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946796.905270:0:12071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522990720:0@lo:104: 00000100:00100000:1.0:1783946796.905361:0:12071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783946796.905431:0:12071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7365 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.905441:0:12071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7365 expref: 18 pid: 5949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946796.906586:0:12071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522990848:0@lo:104: 00000100:00100000:1.0:1783946796.906659:0:12071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946796.907036:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522990720 00000100:00100000:1.0:1783946796.907047:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522990720 00000100:00100000:1.0:1783946796.907134:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522990848 00000100:00100000:1.0:1783946796.907138:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522990848 00000100:00100000:1.0:1783946796.907161:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783946796.907171:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:12071:x1870603522990720:12345-0@lo:104: 00010000:00010000:1.0:1783946796.907192:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.907266:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783946796.907274:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+4:12071:x1870603522990720:12345-0@lo:104: Request processed in 105us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946796.907283:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1783946796.907297:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783946796.907309:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1783946796.907315:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946796.907317:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:12071:x1870603522990848:12345-0@lo:104: 00010000:00010000:3.0:1783946796.907335:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151b000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946796.907340:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.907350:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946796.907358:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946796.907370:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783946796.907432:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.907440:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783946796.907466:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.907474:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff91378151b000/0x229d2ec450db7373 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db737a expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.907764:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946796.907766:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946796.907768:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946796.907799:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522990976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783946796.907925:0:5940:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946796.907941:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783946796.908590:0:5940:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783946796.908600:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:12071:x1870603522990848:12345-0@lo:104: Request processed in 1282us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946796.908608:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1783946796.908760:0:12071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db7357 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.908797:0:12071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db7357 expref: 18 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946796.908813:0:12071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522991104:0@lo:104: 00000100:00100000:1.0:1783946796.908991:0:12071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783946796.909035:0:12071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e28 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.909050:0:12071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e28 expref: 12 pid: 5949 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946796.909079:0:12071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522991232:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783946796.909165:0:12071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e21 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.909174:0:12071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e21 expref: 12 pid: 5950 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946796.909183:0:12071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522991360:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783946796.909209:0:12071:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137980280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946796.909245:0:12071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522990720:0@lo:104: 00000100:00100000:1.0:1783946796.909259:0:12071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522990848:0@lo:104: 00000100:00100000:3.0:1783946796.909731:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522990976 00000100:00100000:3.0:1783946796.909749:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522990976 00010000:00010000:3.0:1783946796.909798:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7373 expref: 19 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946796.909842:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783946796.909852:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522990976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783946796.909870:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946796.909878:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7373 expref: 19 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.909890:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7373 expref: 19 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.909930:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f44e00/0x229d2ec450db737a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7373 expref: 19 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.909949:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946796.910023:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:3448:x1870603522990976:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946796.910032:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1783946796.910106:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946796.910114:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.910123:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151ba00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946796.910129:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.910140:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946796.910148:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946796.910155:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783946796.910222:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.910229:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783946796.910254:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.910261:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff91378151ba00/0x229d2ec450db7365 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db736c expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.910293:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946796.910295:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946796.910297:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946796.910312:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522991488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783946796.910355:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946796.910410:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522991488 00000100:00100000:3.0:1783946796.910415:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522991488 00010000:00010000:3.0:1783946796.910434:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7365 expref: 18 pid: 5949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946796.910461:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783946796.910469:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:3449:x1870603522991488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783946796.910478:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946796.910925:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7365 expref: 18 pid: 5949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.910939:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7365 expref: 18 pid: 5949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.910952:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91378151bc00/0x229d2ec450db736c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7365 expref: 18 pid: 5949 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.910962:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946796.910999:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:3449:x1870603522991488:12345-0@lo:103:ldlm_bl.0 Request processed in 532us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946796.911006:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783946796.911052:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522991488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783946796.911507:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522990976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783946796.911655:0:5939:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000004:00080000:1.0:1783946796.912204:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1783946796.912233:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1783946796.912247:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1783946796.912601:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522991104 00000100:00100000:3.0:1783946796.912609:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522991104 00000100:00100000:3.0:1783946796.913160:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783946796.913241:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:12071:x1870603522991104:12345-0@lo:104: 00010000:00010000:3.0:1783946796.913259:0:5939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.913464:0:5939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783946796.913471:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b032bb55-8d94-4093-96f3-a2f6fadccf82+3:12071:x1870603522991104:12345-0@lo:104: Request processed in 302us (4613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946796.913479:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1783946796.913812:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783946796.913825:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946796.913838:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfe00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:0.0:1783946796.913843:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946796.913854:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783946796.913882:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946796.913888:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783946796.913955:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946796.913962:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783946796.913991:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946796.914000:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35bfe00/0x229d2ec450db7357 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db735e expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946796.914020:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946796.914021:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946796.914023:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946796.914033:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783946796.914052:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522991744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783946796.914088:0:12071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522991104:0@lo:104: 00000100:00100000:3.0:1783946796.914464:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522991616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783946796.914825:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946796.915104:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522991744 00000100:00100000:1.0:1783946796.915126:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522991744 00000100:00100000:1.0:1783946796.915196:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783946796.915206:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522991744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783946796.915240:0:6944:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1783946796.915284:0:6944:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a54de27, atime: 0x6a54de27, ctime: 0x6a54de27, blocks: 0x0 00010000:00010000:1.0:1783946796.915293:0:6944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.915313:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1783946796.915319:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946796.915327:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.915349:0:6944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.915362:0:6944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.915369:0:6944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.915388:0:6944:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783946796.915649:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783946796.916372:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946796.916382:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.916395:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946796.916400:0:5944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.916411:0:5944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783946796.916477:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946796.916524:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522991616 00000100:00100000:2.0:1783946796.916532:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522991616 00010000:00010000:2.0:1783946796.916581:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7357 expref: 17 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946796.916613:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783946796.916622:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3532050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:3450:x1870603522991616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783946796.916637:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946796.916656:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db7357 expref: 17 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.916669:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db7357 expref: 17 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.916687:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622000/0x229d2ec450db735e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db7357 expref: 17 pid: 5951 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.916705:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946796.916748:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946796.916760:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3532050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3450:x1870603522991616:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946796.916769:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1783946796.916785:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b6bb46c/0x229d2ec450db74ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946796.916839:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946796.916841:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3448:x1870603522991744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1633us (2015us total) trans 4294967300 rc 0/0 00010000:00010000:3.0:1783946796.916844:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946796.916851:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946796.916901:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522991616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783946796.916933:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783946796.920176:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946796.920268:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507226496 00000100:00100000:1.0:1783946796.920269:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946796.920281:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507226496 00000004:00080000:0.0:1783946796.920501:0:3448:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be49ea00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1783946796.920512:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522991744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783946796.920756:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 258 00000100:00100000:2.0:1783946796.920770:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507226496:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946796.920877:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507226496:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 110us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946796.920887:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 258 00000100:00100000:3.0:1783946796.923814:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507226624 00000100:00100000:3.0:1783946796.923837:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507226624 00000100:00100000:3.0:1783946796.924210:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:3.0:1783946796.924224:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507226624:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946796.924345:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507226624:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 124us (4075us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946796.924353:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00080000:1.0:1783946796.924463:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946796.932240:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946796.932306:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946796.932382:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507226752 00000100:00100000:2.0:1783946796.932395:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507226752 00000100:00100000:2.0:1783946796.932485:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:2.0:1783946796.932499:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507226752:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946796.932614:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507226752:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 118us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946796.932644:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00080000:2.0:1783946796.932679:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946796.932916:0:12071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522991232:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783946796.932931:0:12071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12071:1870603522991360:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783946796.932972:0:12071:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946796.933288:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507226880 00000100:00100000:0.0:1783946796.933294:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507226880 00000100:00100000:0.0:1783946796.933367:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:0.0:1783946796.933375:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507226880:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946796.933422:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507226880:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 49us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946796.933438:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00080000:2.0:1783946796.933871:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946796.938693:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946796.938763:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946796.939011:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507227008 00000100:00100000:2.0:1783946796.939025:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507227008 00010000:00010000:2.0:1783946796.939121:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e28 expref: 13 pid: 5949 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946796.939170:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507227136 00000100:00100000:2.0:1783946796.939173:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507227136 00010000:00010000:2.0:1783946796.939188:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e21 expref: 14 pid: 5950 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946796.939210:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1783946796.939220:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+14:2361:x1870603507227008:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946796.939238:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946796.939244:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e28 expref: 14 pid: 5949 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939271:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e28 expref: 14 pid: 5949 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939296:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f44600/0x229d2ec450db7350 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e28 expref: 14 pid: 5949 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939318:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946796.939590:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507227008:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 369us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946796.939599:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1783946796.939643:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:2.0:1783946796.939651:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:2361:x1870603507227136:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946796.939660:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946796.939665:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e21 expref: 12 pid: 5950 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939674:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e21 expref: 12 pid: 5950 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939686:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bf800/0x229d2ec450db7349 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571e21 expref: 12 pid: 5950 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939700:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939710:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939731:0:5941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939740:0:5941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939749:0:5941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939756:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939764:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946796.939775:0:5941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939785:0:5941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939800:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946796.939813:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946796.939836:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:2361:x1870603507227136:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 185us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946796.939843:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00010000:00010000:1.0:1783946796.940642:0:12071:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.940663:0:12071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946796.940670:0:12071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f45e00/0x229d2ec450db74a7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946797.200205:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946798.130425:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946798.130497:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507227264 00000100:00100000:0.0:1783946798.130510:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507227264 00000100:00100000:0.0:1783946798.130632:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 259 00000100:00100000:0.0:1783946798.130645:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:5452:x1870603507227264:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946798.130669:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946798.130694:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137be3a9a00/0x229d2ec450db74b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571e75 expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946798.130725:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137be3a9a00/0x229d2ec450db74b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e75 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946798.130734:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137be3a9a00/0x229d2ec450db74b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e75 expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946798.130743:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9a00, rc 0) 00000100:00100000:0.0:1783946798.130987:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507227264:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 342us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.130996:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 259 00000100:00100000:1.0:1783946798.135950:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946798.136103:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507227392 00000100:00100000:2.0:1783946798.136116:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507227392 00000100:00100000:2.0:1783946798.136198:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 260 00000100:00100000:2.0:1783946798.136212:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507227392:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.136613:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507227392:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 401us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.136622:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 260 00000100:00100000:3.0:1783946798.141193:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946798.141357:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507227520 00000100:00100000:0.0:1783946798.141369:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507227520 00000100:00100000:0.0:1783946798.141448:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 261 00000100:00100000:0.0:1783946798.141460:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507227520:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783946798.141653:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507227520:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 196us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.141668:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 261 00000100:00100000:3.0:1783946798.145283:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946798.145705:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507227648 00000100:00100000:2.0:1783946798.145728:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507227648 00000100:00100000:2.0:1783946798.145802:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 262 00000100:00100000:2.0:1783946798.145814:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:9916:x1870603507227648:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783946798.146208:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:9916:x1870603507227648:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 394us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.146218:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 262 00000100:00100000:1.0:1783946798.149577:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946798.149737:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507227776 00000100:00100000:2.0:1783946798.149750:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507227776 00000100:00100000:2.0:1783946798.149827:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 263 00000100:00100000:2.0:1783946798.149838:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:9916:x1870603507227776:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783946798.150039:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:9916:x1870603507227776:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 202us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.150049:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 263 00000100:00100000:3.0:1783946798.152991:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946798.153340:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507227904 00000100:00100000:0.0:1783946798.153356:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507227904 00000100:00100000:0.0:1783946798.153441:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 264 00000100:00100000:0.0:1783946798.153453:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:5452:x1870603507227904:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946798.153477:0:5950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946798.153502:0:5950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137be3a8000/0x229d2ec450db74bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f571e7c expref: -99 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946798.153543:0:5950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137be3a8000/0x229d2ec450db74bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e7c expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946798.153557:0:5950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137be3a8000/0x229d2ec450db74bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e7c expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946798.153567:0:5950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8000, rc 0) 00000100:00100000:0.0:1783946798.153645:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507227904:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 194us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.153653:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 264 00000100:00100000:3.0:1783946798.163548:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946798.163953:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507228032 00000100:00100000:0.0:1783946798.163969:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507228032 00000100:00100000:0.0:1783946798.164056:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 265 00000100:00100000:0.0:1783946798.164128:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507228032:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946798.164344:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507228032:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 218us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.164352:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 265 00000100:00100000:1.0:1783946798.176355:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946798.176616:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507228160 00000100:00100000:2.0:1783946798.176631:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507228160 00000100:00100000:2.0:1783946798.176725:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 266 00000100:00100000:2.0:1783946798.176741:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507228160:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.176992:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:5452:x1870603507228160:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 254us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.177001:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 266 00000100:00100000:2.0:1783946798.180905:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946798.183015:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507228288 00000100:00100000:3.0:1783946798.183051:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507228288 00000100:00100000:2.0:1783946798.183552:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 267 00000100:00100000:2.0:1783946798.183569:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:9919:x1870603507228288:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783946798.183875:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:9919:x1870603507228288:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 293us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.183885:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 267 00000100:00100000:3.0:1783946798.187481:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946798.196902:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507228416 00000100:00100000:0.0:1783946798.196921:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507228416 00000100:00100000:0.0:1783946798.197001:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 268 00000100:00100000:0.0:1783946798.197014:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:9919:x1870603507228416:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783946798.197598:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:9919:x1870603507228416:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 584us (10128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.197608:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 268 00010000:00010000:3.0:1783946798.224598:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783946798.288377:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783946798.288390:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137a7c0f800 from 7 10000000:01000000:2.0:1783946798.288396:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783946798.288479:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.288520:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.288534:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946798.288570:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522991872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.288671:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946798.288814:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946798.290425:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522991872 00000100:00100000:0.0:1783946798.290444:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522991872 00000100:00100000:0.0:1783946798.290531:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783946798.290543:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:5953:x1870603522991872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783946798.290565:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946798.290590:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137be3a8800/0x229d2ec450db74ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db74c3 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946798.290626:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137be3a8800/0x229d2ec450db74ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db74c3 expref: 17 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946798.290985:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137be3a8800/0x229d2ec450db74ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db74c3 expref: 17 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946798.291000:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8800, rc 0) 00000100:00100000:0.0:1783946798.291438:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522991872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 894us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.291447:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1783946798.291665:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522991872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783946798.291689:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946798.291698:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946798.291806:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783946798.291843:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946798.291897:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028000 going to sleep for 11 seconds 00000100:00100000:0.0:1783946798.291980:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522992000 00000100:00100000:0.0:1783946798.291985:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522992000 00000100:00100000:0.0:1783946798.292019:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783946798.292035:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522992000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946798.292775:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522992000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 735us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.292786:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783946798.292876:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946798.292918:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946798.292968:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946798.293006:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790b953c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946798.293090:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522992128 00000100:00100000:2.0:1783946798.293097:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522992128 00000100:00100000:2.0:1783946798.293197:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783946798.293205:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522992128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.293290:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522992128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.293295:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1783946798.293382:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946798.294022:0:12084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12084:1870603522992256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946798.294201:0:12084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946798.294226:0:12084:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790b95240 going to sleep for 11 seconds 00000100:00100000:0.0:1783946798.294278:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522992256 00000100:00100000:0.0:1783946798.294282:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522992256 00000100:00100000:0.0:1783946798.294317:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1783946798.294324:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:12084:x1870603522992256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946798.294633:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:12084:x1870603522992256:12345-0@lo:502:llog_process_th.0 Request processed in 308us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.294639:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783946798.294723:0:12084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12084:1870603522992256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783946798.294753:0:12084:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783946798.294766:0:12084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946798.294768:0:12084:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783946798.294776:0:12084:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9137a7c0f800 00000020:00000080:3.0:1783946798.294779:0:12084:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783946798.294875:0:12084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12084:1870603522992384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946798.294903:0:12084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946798.294921:0:12084:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790b95240 going to sleep for 11 seconds 00000100:00100000:1.0:1783946798.295114:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522992384 00000100:00100000:1.0:1783946798.295118:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522992384 00000100:00100000:1.0:1783946798.295152:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1783946798.295159:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:12084:x1870603522992384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783946798.295229:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:12084:x1870603522992384:12345-0@lo:502:llog_process_th.0 Request processed in 70us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946798.295234:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783946798.295347:0:12084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12084:1870603522992384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783946798.295362:0:12084:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783946798.295364:0:12084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946798.295366:0:12084:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783946798.295369:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783946798.296390:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783946798.296506:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783946798.296521:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946798.296533:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946798.296542:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783946798.296544:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137b63de800 from 7 10000000:01000000:1.0:1783946798.296546:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783946798.296581:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946798.296587:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946798.296596:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946798.296615:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783946798.296661:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946798.296755:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028480 going to sleep for 11 seconds 00000100:00100000:2.0:1783946798.302301:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522992512 00000100:00100000:2.0:1783946798.302321:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522992512 00000100:00100000:2.0:1783946798.302710:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783946798.302728:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:5953:x1870603522992512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946798.302757:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946798.302790:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797622c00/0x229d2ec450db74d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db74d1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.302838:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622c00/0x229d2ec450db74d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db74d1 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.302875:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797622c00/0x229d2ec450db74d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db74d1 expref: 18 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.302887:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622c00, rc 0) 00000100:00100000:2.0:1783946798.303024:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522992512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 301us (6360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.303032:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1783946798.303221:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783946798.303247:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946798.303256:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946798.303356:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783946798.303391:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946798.318213:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946798.320295:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522992640 00000100:00100000:0.0:1783946798.320320:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522992640 00000100:00100000:0.0:1783946798.320390:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1783946798.320406:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522992640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783946798.320711:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522992640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (17318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.320721:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1783946798.321219:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783946798.321305:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783946798.321390:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946798.321551:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790b95240 going to sleep for 11 seconds 00000100:00100000:2.0:1783946798.321703:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522992768 00000100:00100000:2.0:1783946798.321710:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522992768 00000100:00100000:2.0:1783946798.321768:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783946798.321779:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522992768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.321898:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522992768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.321906:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783946798.321956:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522992768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783946798.322973:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783946798.323675:0:12088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12088:1870603522992896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946798.323771:0:12088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946798.323814:0:12088:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783946798.323914:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522992896 00000100:00100000:2.0:1783946798.323923:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522992896 00000100:00100000:2.0:1783946798.323984:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1783946798.323994:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:12088:x1870603522992896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946798.325887:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:12088:x1870603522992896:12345-0@lo:502:llog_process_th.0 Request processed in 1883us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.325903:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1783946798.326415:0:12088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12088:1870603522992896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783946798.326586:0:12088:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946798.326599:0:12088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946798.326602:0:12088:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783946798.326611:0:12088:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9137b63de800 00000020:00000080:0.0:1783946798.326624:0:12088:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783946798.327264:0:12088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12088:1870603522993024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946798.327350:0:12088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946798.327399:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522993024 00000100:00100000:0.0:1783946798.327408:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522993024 00000100:00100000:0.0:1783946798.327476:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1783946798.327486:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:12088:x1870603522993024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946798.327619:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:12088:x1870603522993024:12345-0@lo:502:llog_process_th.0 Request processed in 133us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946798.327627:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1783946798.327689:0:12088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1783946798.327708:0:12088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12088:1870603522993024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783946798.327729:0:12088:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946798.327736:0:12088:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946798.327738:0:12088:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783946798.327742:0:12088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783946798.329393:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783946798.329449:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783946798.329463:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.329487:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946798.329500:0:5953:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783946798.329503:0:5953:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff913786178000 from 7 10000000:01000000:2.0:1783946798.329506:0:5953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783946798.329554:0:5953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.329564:0:5953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.329576:0:5953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946798.329606:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522993152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.329683:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946798.329733:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787c04900 going to sleep for 11 seconds 00000100:00100000:2.0:1783946798.330098:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522993152 00000100:00100000:2.0:1783946798.330117:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522993152 00000100:00100000:2.0:1783946798.330179:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1783946798.330191:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:5953:x1870603522993152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946798.330209:0:5951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946798.330226:0:5951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797622600/0x229d2ec450db74e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db74df expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.330254:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622600/0x229d2ec450db74e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db74df expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.330281:0:5951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797622600/0x229d2ec450db74e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db74df expref: 19 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.330292:0:5951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622600, rc 0) 00000100:00100000:2.0:1783946798.330340:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522993152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.330348:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1783946798.330407:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522993152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946798.330439:0:5953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.330450:0:5953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946798.330531:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522993280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.330559:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946798.330584:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787c04900 going to sleep for 11 seconds 00000100:00100000:2.0:1783946798.330598:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522993280 00000100:00100000:2.0:1783946798.330603:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522993280 00000100:00100000:2.0:1783946798.330624:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783946798.330630:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522993280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.330759:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522993280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.330767:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783946798.330793:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522993280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.330832:0:5953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522993408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.330876:0:5953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946798.330889:0:5953:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787c04900 going to sleep for 11 seconds 00000100:00100000:2.0:1783946798.330901:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522993408 00000100:00100000:2.0:1783946798.330904:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522993408 00000100:00100000:2.0:1783946798.330924:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1783946798.330930:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522993408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.331015:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:5953:x1870603522993408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.331022:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1783946798.331113:0:5953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b032bb55-8d94-4093-96f3-a2f6fadccf82:5953:1870603522993408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783946798.331452:0:12089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12089:1870603522993536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946798.331491:0:12089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946798.331511:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522993536 00000100:00100000:2.0:1783946798.331515:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522993536 00000100:00100000:2.0:1783946798.331537:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783946798.331544:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:12089:x1870603522993536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946798.331623:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:12089:x1870603522993536:12345-0@lo:502:llog_process_th.0 Request processed in 77us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.331629:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783946798.331658:0:12089:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787c04b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783946798.331671:0:12089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12089:1870603522993536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783946798.331693:0:12089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783946798.331705:0:12089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946798.331712:0:12089:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783946798.331722:0:12089:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff913786178000 00000020:00000080:2.0:1783946798.331725:0:12089:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783946798.336537:0:12089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12089:1870603522993664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946798.336672:0:12089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946798.336742:0:12089:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790b953c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946798.337201:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522993664 00000100:00100000:2.0:1783946798.337213:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522993664 00000100:00100000:2.0:1783946798.337289:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1783946798.337302:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:12089:x1870603522993664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946798.337509:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:12089:x1870603522993664:12345-0@lo:502:llog_process_th.0 Request processed in 208us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946798.337518:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1783946798.337680:0:12089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b032bb55-8d94-4093-96f3-a2f6fadccf82:12089:1870603522993664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783946798.337734:0:12089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946798.337745:0:12089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946798.337749:0:12089:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783946798.337754:0:12089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783946798.338501:0:5953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783946798.338536:0:5953:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783946798.338551:0:5953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946798.338566:0:5953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946798.994798:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946798.994825:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522993792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946798.994926:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946798.997152:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522993792 00000100:00100000:1.0:1783946798.997168:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522993792 00000100:00100000:1.0:1783946798.997304:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783946798.997318:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1870603522993792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946798.997365:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946798.997446:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1870603522993792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946798.997456:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1783946798.997771:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946798.997819:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522993792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783946799.249187:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783946799.378016:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783946800.016642:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522993920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946800.016663:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522994304:0@lo:400:kworker.0 00000100:00100000:1.0:1783946800.016757:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522994176:0@lo:400:kworker.0 00000100:00100000:0.0:1783946800.016995:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522994048:0@lo:400:kworker.0 00000100:00100000:2.0:1783946800.020171:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946800.020332:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522994304 00000100:00100000:2.0:1783946800.020340:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522994304 00000100:00100000:2.0:1783946800.020399:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783946800.020421:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522994304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946800.020484:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522994304:12345-0@lo:400:kworker.0 Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946800.020491:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1783946800.020512:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946800.020540:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522994304:0@lo:400:kworker.0 00000100:00100000:3.0:1783946800.022312:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946800.022476:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522993920 00000100:00100000:2.0:1783946800.022486:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522993920 00000100:00100000:2.0:1783946800.022550:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783946800.022559:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522993920:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783946800.022677:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783946800.022720:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522994432:0@lo:400:kworker.0 00000100:00100000:3.0:1783946800.022775:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946800.022815:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522994432 00000100:00100000:3.0:1783946800.022819:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522994432 00000100:00100000:3.0:1783946800.022856:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783946800.022863:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603522994432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946800.022906:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603522994432:12345-0@lo:400:kworker.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946800.022913:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1783946800.022933:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946800.022956:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522994432:0@lo:400:kworker.0 00002000:00000024:2.0:1783946800.023035:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946800.023239:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522993920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 680us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946800.023247:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1783946800.023315:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be49ca80 x1870603522993920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946800.023331:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522993920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946800.033361:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946800.033455:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522994688:0@lo:400:kworker.0 00000100:00100000:1.0:1783946800.033502:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946800.034237:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522994176 00000100:00100000:2.0:1783946800.034247:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522994176 00000100:00100000:2.0:1783946800.034312:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783946800.034322:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522994176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946800.034393:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522994176:12345-0@lo:400:kworker.0 Request processed in 73us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946800.034401:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783946800.035290:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522994688 00000100:00100000:3.0:1783946800.035298:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522994688 00000100:00100000:3.0:1783946800.035348:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783946800.035357:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522994688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946800.035422:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522994688:12345-0@lo:400:kworker.0 Request processed in 66us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946800.035430:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783946800.037032:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522994176:0@lo:400:kworker.0 00010000:00080000:1.0:1783946800.037126:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be3f3480 x1870603522994688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946800.037137:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522994688:0@lo:400:kworker.0 00000100:00100000:1.0:1783946800.046861:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946800.047019:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522994560:0@lo:400:kworker.0 00000100:00100000:1.0:1783946800.047097:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946800.047268:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522994560 00000100:00100000:0.0:1783946800.047277:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522994560 00000100:00100000:0.0:1783946800.047352:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783946800.047362:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522994560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946800.047445:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522994560:12345-0@lo:400:kworker.0 Request processed in 84us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946800.047463:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1783946800.047487:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946800.047651:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522994560:0@lo:400:kworker.0 00000100:00100000:2.0:1783946800.047989:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522994048 00000100:00100000:2.0:1783946800.047995:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522994048 00000100:00100000:2.0:1783946800.048114:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1783946800.048123:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522994048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946800.048179:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522994048:12345-0@lo:400:kworker.0 Request processed in 57us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946800.048194:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783946800.048277:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522994048:0@lo:400:kworker.0 00010000:00010000:3.0:1783946800.272988:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946801.298484:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946802.032819:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946802.032901:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946802.033094:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507228544 00000100:00100000:3.0:1783946802.033107:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507228544 00000100:00100000:3.0:1783946802.033177:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 285 00000100:00100000:3.0:1783946802.033189:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507228544:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946802.033369:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507228544:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 88us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946802.033379:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 285 00000100:00100000:2.0:1783946802.033798:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507228672 00000100:00100000:2.0:1783946802.033804:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507228672 00000100:00100000:2.0:1783946802.033882:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:2.0:1783946802.033891:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507228672:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946802.033931:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507228672:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 41us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946802.033938:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:1.0:1783946802.034115:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946802.034192:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946802.034265:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507228800 00000100:00100000:1.0:1783946802.034270:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507228800 00000100:00100000:1.0:1783946802.034322:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:1.0:1783946802.034330:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507228800:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946802.034368:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507228800:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 39us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946802.034374:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:2.0:1783946802.034975:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507228928 00000100:00100000:2.0:1783946802.034983:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507228928 00000100:00100000:2.0:1783946802.035046:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:2.0:1783946802.035055:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507228928:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946802.035153:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507228928:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 98us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946802.035161:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00080000:3.0:1783946802.035672:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783946802.035678:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783946802.323487:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783946803.092038:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1783946803.345250:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946804.115202:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783946804.115225:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522994816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946804.115296:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946804.115451:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522994816 00000100:00100000:1.0:1783946804.115460:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522994816 00000100:00100000:1.0:1783946804.115532:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783946804.115542:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522994816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946804.115595:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946804.115645:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522994816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946804.115652:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783946804.115687:0:3447:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1783946804.115693:0:3447:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be49ea00, transno 4294967300 00000100:00100000:1.0:1783946804.115709:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522994816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783946804.116086:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783946804.368308:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946805.136888:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522995200:0@lo:400:kworker.0 00000100:00100000:3.0:1783946805.136991:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946805.137057:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783946805.137081:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522995328:0@lo:400:kworker.0 00000100:00100000:3.0:1783946805.137109:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946805.137145:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522995328 00000100:00100000:3.0:1783946805.137152:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522995328 00000100:00100000:3.0:1783946805.137211:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783946805.137221:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522995328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946805.137273:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522995328:12345-0@lo:400:kworker.0 Request processed in 53us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946805.137281:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783946805.137323:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522995328:0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.137461:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522995200 00000100:00100000:2.0:1783946805.137466:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522995200 00000100:00100000:2.0:1783946805.137511:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783946805.137519:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522995200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.137557:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522995200:12345-0@lo:400:kworker.0 Request processed in 39us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946805.137563:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783946805.137593:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522995200:0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.137609:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be54b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522995072:0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.137644:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946805.137661:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522995584:0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.137682:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946805.137701:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783946805.137706:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522994944:0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.137728:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946805.137745:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522995456:0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.137761:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946805.137781:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522995072 00000100:00100000:2.0:1783946805.137784:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522995072 00000100:00100000:2.0:1783946805.137804:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522995456 00000100:00100000:2.0:1783946805.137806:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522995456 00000100:00100000:2.0:1783946805.137821:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783946805.137827:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522995072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.137858:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522995072:12345-0@lo:400:kworker.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946805.137865:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783946805.137877:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783946805.137882:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522995456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.137906:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522995456:12345-0@lo:400:kworker.0 Request processed in 25us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946805.137912:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783946805.137929:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522994944 00000100:00100000:2.0:1783946805.137932:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522994944 00000100:00100000:2.0:1783946805.137952:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1783946805.137970:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522994944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.138008:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603522994944:12345-0@lo:400:kworker.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946805.138015:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1783946805.138049:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603522994944:0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.138080:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522995456:0@lo:400:kworker.0 00000100:00100000:2.0:1783946805.138092:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be54b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522995072:0@lo:400:kworker.0 00000100:00100000:0.0:1783946805.139126:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522995584 00000100:00100000:0.0:1783946805.139146:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522995584 00000100:00100000:0.0:1783946805.139195:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783946805.139205:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522995584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946805.139265:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522995584:12345-0@lo:400:kworker.0 Request processed in 62us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946805.139272:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1783946805.139390:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be582a00 x1870603522995584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946805.139403:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522995584:0@lo:400:kworker.0 00000100:00100000:1.0:1783946805.139813:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783946805.139825:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522995712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946805.139864:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946805.139895:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522995712 00000100:00100000:1.0:1783946805.139899:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522995712 00000100:00100000:1.0:1783946805.139926:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783946805.139933:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522995712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946805.139966:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946805.140002:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522995712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946805.140009:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1783946805.140034:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be49ea00 x1870603522995712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946805.140048:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522995712:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783946805.140178:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783946805.140183:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783946805.392233:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946806.417563:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946807.155427:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946807.155484:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946807.155542:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946807.155590:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946807.155635:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507229312 00000100:00100000:0.0:1783946807.155645:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507229312 00000100:00100000:0.0:1783946807.155706:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:0.0:1783946807.155717:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507229312:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946807.155789:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507229312:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946807.155797:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00080000:0.0:1783946807.155832:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946807.156002:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507229184 00000100:00100000:2.0:1783946807.156007:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507229184 00000100:00100000:2.0:1783946807.156047:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507229440 00000100:00100000:2.0:1783946807.156050:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507229440 00000100:00100000:2.0:1783946807.156124:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:2.0:1783946807.156133:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507229184:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946807.156166:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507229184:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 35us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946807.156172:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:2.0:1783946807.156185:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 132 00000100:00100000:2.0:1783946807.156191:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507229440:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946807.156215:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507229440:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946807.156220:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 132 00000100:00080000:0.0:1783946807.156449:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946807.156852:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507229056 00000100:00100000:1.0:1783946807.156857:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507229056 00000100:00100000:1.0:1783946807.156898:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 287 00000100:00100000:1.0:1783946807.156906:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507229056:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946807.156979:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507229056:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 74us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946807.156985:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 287 00010000:00010000:1.0:1783946807.472998:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946808.529380:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946809.235029:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522995840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946809.235179:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946809.235374:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522995840 00000100:00100000:1.0:1783946809.235383:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522995840 00000100:00100000:1.0:1783946809.235455:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1783946809.235459:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946809.235466:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522995840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946809.235495:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946809.235563:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522995840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946809.235570:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783946809.235664:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522995840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783946809.552759:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783946809.616714:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783946810.256362:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522995968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946810.256452:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946810.256520:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946810.256526:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522996096:0@lo:400:kworker.0 00000100:00100000:0.0:1783946810.256570:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946810.256610:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522996096 00000100:00100000:0.0:1783946810.256618:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522996096 00000100:00100000:0.0:1783946810.256660:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1783946810.256679:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522996096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946810.256733:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522996096:12345-0@lo:400:kworker.0 Request processed in 65us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946810.256741:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1783946810.256790:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522996096:0@lo:400:kworker.0 00000100:00100000:1.0:1783946810.257257:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522995968 00000100:00100000:1.0:1783946810.257263:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522995968 00000100:00100000:1.0:1783946810.257315:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783946810.257324:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522995968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946810.257349:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946810.257402:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522995968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946810.257408:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1783946810.258775:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783946810.258813:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be49c000 x1870603522995968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946810.258834:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522995968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946810.262010:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522996224:0@lo:400:kworker.0 00000100:00100000:0.0:1783946810.262011:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522996480:0@lo:400:kworker.0 00000100:00100000:2.0:1783946810.262094:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522996608:0@lo:400:kworker.0 00000100:00100000:1.0:1783946810.262170:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522996352:0@lo:400:kworker.0 00000100:00100000:0.0:1783946810.269739:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946810.269818:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522996480 00000100:00100000:0.0:1783946810.269827:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522996480 00000100:00100000:0.0:1783946810.269903:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783946810.269919:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522996480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946810.269959:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946810.270007:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522996224 00000100:00100000:0.0:1783946810.270010:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522996480:12345-0@lo:400:kworker.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946810.270012:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522996224 00000100:00100000:0.0:1783946810.270022:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783946810.270047:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783946810.270056:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522996224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946810.270108:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522996480:0@lo:400:kworker.0 00000100:00100000:3.0:1783946810.270116:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603522996224:12345-0@lo:400:kworker.0 Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946810.270123:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783946810.271762:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603522996224:0@lo:400:kworker.0 00000100:00100000:2.0:1783946810.277268:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946810.278405:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522996608 00000100:00100000:3.0:1783946810.278417:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522996608 00000100:00100000:3.0:1783946810.278583:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783946810.278611:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522996608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946810.278755:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522996608:12345-0@lo:400:kworker.0 Request processed in 163us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946810.278813:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783946810.278933:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522996608:0@lo:400:kworker.0 00000100:00080000:0.0:1783946810.281093:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946810.283330:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946810.284004:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522996352 00000100:00100000:0.0:1783946810.284014:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522996352 00000100:00080000:3.0:1783946810.284376:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946810.285361:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783946810.285378:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522996352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946810.285470:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603522996352:12345-0@lo:400:kworker.0 Request processed in 98us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946810.285477:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783946810.285580:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603522996352:0@lo:400:kworker.0 00010000:00010000:3.0:1783946810.577653:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946811.600922:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946812.279038:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946812.279141:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946812.279416:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507229696 00000100:00100000:3.0:1783946812.279426:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507229696 00000100:00100000:3.0:1783946812.279522:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 136 00000100:00100000:3.0:1783946812.279533:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507229696:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946812.279616:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507229696:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 86us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946812.279625:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 136 00000100:00100000:2.0:1783946812.279762:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507229568 00000100:00100000:2.0:1783946812.279769:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507229568 00000100:00080000:0.0:1783946812.279770:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946812.279817:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 289 00000100:00100000:2.0:1783946812.279826:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507229568:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946812.279872:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507229568:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 47us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946812.279880:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 289 00000100:00100000:0.0:1783946812.298885:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946812.298947:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946812.299284:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507229824 00000100:00100000:3.0:1783946812.299298:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507229824 00000100:00100000:3.0:1783946812.299405:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:3.0:1783946812.299419:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2360:x1870603507229824:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:3.0:1783946812.299462:0:9002:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7422 00000100:00080000:3.0:1783946812.299483:0:9002:0:(import.c:65:import_set_state_nolock()) ffff9137bdf76000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783946812.299558:0:9002:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1783946812.299787:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+2:2360:x1870603507229824:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 370us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946812.299795:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00010000:00010000:3.0:1783946812.299826:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946812.300174:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507229952 00000100:00100000:2.0:1783946812.300189:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507229952 00000100:00100000:2.0:1783946812.300288:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 137 00000100:00100000:2.0:1783946812.300300:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2363:x1870603507229952:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946812.300382:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2363:x1870603507229952:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 85us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946812.300389:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 137 00000100:00080000:0.0:1783946812.300505:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783946812.300514:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783946812.624358:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946813.648417:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946814.356094:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783946814.356128:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522996736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946814.356227:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946814.357165:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522996736 00000100:00100000:1.0:1783946814.357180:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522996736 00000100:00100000:1.0:1783946814.357273:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783946814.357286:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522996736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946814.357332:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946814.357445:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522996736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946814.357454:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783946814.357538:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522996736:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783946814.357688:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783946814.672960:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946815.376956:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522996864:0@lo:400:kworker.0 00000100:00100000:2.0:1783946815.377094:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946815.377175:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522997376:0@lo:400:kworker.0 00000100:00100000:2.0:1783946815.377214:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946815.377240:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946815.377246:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522997248:0@lo:400:kworker.0 00000100:00100000:2.0:1783946815.377275:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946815.377346:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522997376 00000100:00100000:2.0:1783946815.377355:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522997376 00000100:00100000:3.0:1783946815.377361:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522997120:0@lo:400:kworker.0 00000100:00100000:3.0:1783946815.377411:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946815.377435:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783946815.377441:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522996992:0@lo:400:kworker.0 00000100:00100000:3.0:1783946815.377462:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946815.377482:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522997504:0@lo:400:kworker.0 00000100:00100000:3.0:1783946815.377502:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946815.377535:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522997248 00000100:00100000:3.0:1783946815.377540:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522997248 00000100:00100000:3.0:1783946815.377572:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522997504 00000100:00100000:3.0:1783946815.377574:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522997504 00000100:00100000:3.0:1783946815.377622:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783946815.377633:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522997248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946815.377700:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522996864 00000100:00100000:1.0:1783946815.377706:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522996864 00000100:00100000:1.0:1783946815.377736:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1783946815.377742:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522996864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946815.377812:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603522996864:12345-0@lo:400:kworker.0 Request processed in 69us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946815.377821:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1783946815.377860:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522997120 00000100:00100000:1.0:1783946815.377863:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522997120 00000100:00100000:1.0:1783946815.377882:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522996992 00000100:00100000:1.0:1783946815.377885:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522996992 00000100:00100000:1.0:1783946815.377899:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783946815.377906:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522997376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946815.377942:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522997376:12345-0@lo:400:kworker.0 Request processed in 36us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946815.377948:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783946815.377962:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783946815.377968:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522997120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946815.378012:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603522997120:12345-0@lo:400:kworker.0 Request processed in 45us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946815.378019:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783946815.378031:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783946815.378036:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522996992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946815.378094:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522996992:12345-0@lo:400:kworker.0 Request processed in 57us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946815.378101:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783946815.378124:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783946815.378132:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522997504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946815.378162:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522997504:12345-0@lo:400:kworker.0 Request processed in 31us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946815.378167:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783946815.378262:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522997376:0@lo:400:kworker.0 00000100:00100000:1.0:1783946815.378275:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603522996864:0@lo:400:kworker.0 00000100:00080000:1.0:1783946815.378305:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783946815.378311:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946815.378725:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522996992:0@lo:400:kworker.0 00010000:00080000:2.0:1783946815.378752:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be583100 x1870603522997504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783946831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946815.378764:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522997504:0@lo:400:kworker.0 00000100:00100000:2.0:1783946815.378776:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603522997120:0@lo:400:kworker.0 00000100:00100000:3.0:1783946815.380172:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522997248:12345-0@lo:400:kworker.0 Request processed in 2529us (2883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946815.380253:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783946815.380331:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522997248:0@lo:400:kworker.0 00000100:00100000:1.0:1783946815.382963:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783946815.383002:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522997632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946815.383122:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946815.383235:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522997632 00000100:00100000:0.0:1783946815.383246:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522997632 00000100:00100000:0.0:1783946815.383318:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783946815.383330:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522997632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783946815.383401:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946815.383464:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522997632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946815.383472:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1783946815.383595:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be4ca300 x1870603522997632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946815.383621:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522997632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783946815.697266:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946816.720443:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946817.393787:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946817.393840:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946817.393865:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507230208 00000100:00100000:0.0:1783946817.393884:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946817.393890:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507230208 00000100:00100000:0.0:1783946817.393912:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507230336 00000100:00100000:0.0:1783946817.393917:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507230336 00000100:00100000:0.0:1783946817.393982:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 141 00000100:00100000:0.0:1783946817.393996:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507230336:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946817.394023:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507230080 00000100:00100000:2.0:1783946817.394027:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507230080 00000100:00100000:0.0:1783946817.394139:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507230336:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 134us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946817.394149:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 141 00000100:00100000:1.0:1783946817.394601:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 142 00000100:00100000:1.0:1783946817.394611:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507230208:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946817.394648:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507230208:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 40us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946817.394655:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 142 00000100:00080000:1.0:1783946817.394680:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946817.394842:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 291 00000100:00100000:2.0:1783946817.394852:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507230080:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946817.395102:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507230080:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 251us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946817.395109:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 291 00010000:00010000:1.0:1783946817.745410:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783946817.947429:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:3.0:1783946817.947440:0:6938:0:(genops.c:906:class_export_put()) final put ffff9137bdf71000/c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:1.0:1783946817.947501:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137bdf71000/c2268401-da9f-4e1e-8a1c-9473caf67cba for lustre-OST0000 00000020:00000080:1.0:1783946817.947555:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137bdf76000 for lustre-OST0000 00010000:00010000:1.0:1783946818.793486:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946819.472371:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783946819.472405:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522997760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946819.472510:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946819.472729:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522997760 00000100:00100000:0.0:1783946819.472739:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522997760 00000100:00100000:0.0:1783946819.472828:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783946819.472840:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522997760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946819.472883:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946819.472945:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522997760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946819.472954:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783946819.473027:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522997760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783946819.473197:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783946819.858681:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783946819.860363:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783946820.496366:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522997888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946820.496458:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946820.496565:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522997888 00000100:00100000:2.0:1783946820.496574:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522997888 00000100:00100000:2.0:1783946820.496645:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783946820.496656:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522997888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783946820.496730:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946820.497128:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603522997888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 472us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946820.497136:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1783946820.497183:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783946820.497265:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be4c8000 x1870603522997888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946820.497288:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603522997888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946820.500048:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522998016:0@lo:400:kworker.0 00000100:00100000:1.0:1783946820.500187:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946820.500495:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522998016 00000100:00100000:3.0:1783946820.500505:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522998016 00000100:00100000:3.0:1783946820.500579:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1783946820.500590:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522998016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.503677:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522998144:0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.503809:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946820.503855:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783946820.503862:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522998528:0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.503899:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946820.503930:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522998272:0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.503953:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946820.503973:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783946820.503978:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522998400:0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.504003:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946820.504037:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522998144 00000100:00100000:0.0:1783946820.504046:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522998144 00000100:00100000:0.0:1783946820.504125:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522998528 00000100:00100000:0.0:1783946820.504129:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522998528 00000100:00100000:0.0:1783946820.504155:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522998272 00000100:00100000:0.0:1783946820.504158:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522998272 00000100:00100000:0.0:1783946820.504177:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783946820.504187:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522998144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.504613:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603522998144:12345-0@lo:400:kworker.0 Request processed in 426us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946820.504622:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783946820.504646:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783946820.504653:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522998528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.504798:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603522998528:12345-0@lo:400:kworker.0 Request processed in 145us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946820.504805:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783946820.504817:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783946820.504824:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522998272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.504865:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603522998272:12345-0@lo:400:kworker.0 Request processed in 41us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946820.504871:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1783946820.504900:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946820.504938:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603522998272:0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.504972:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603522998528:0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.504982:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603522998144:0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.505036:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522998400 00000100:00100000:0.0:1783946820.505040:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522998400 00000100:00100000:0.0:1783946820.505096:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783946820.505102:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522998400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946820.505141:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522998400:12345-0@lo:400:kworker.0 Request processed in 39us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946820.505147:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783946820.505169:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522998400:0@lo:400:kworker.0 00000100:00100000:3.0:1783946820.505509:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603522998016:12345-0@lo:400:kworker.0 Request processed in 4918us (5320us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946820.505526:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1783946820.506320:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603522998016:0@lo:400:kworker.0 00010000:00010000:1.0:1783946820.882886:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783946821.377903:0:12247:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:47:00 (1783946820) 00010000:00010000:0.0:1783946821.906723:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946822.520608:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946822.520654:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946822.520705:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946822.520855:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507230464 00000100:00100000:2.0:1783946822.520883:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507230464 00000100:00100000:2.0:1783946822.520979:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 293 00000100:00100000:2.0:1783946822.520992:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507230464:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946822.521146:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507230464:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 157us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946822.521154:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 293 00000100:00100000:1.0:1783946822.521364:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507230720 00000100:00100000:1.0:1783946822.521370:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507230720 00000100:00100000:1.0:1783946822.521430:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507230592 00000100:00100000:1.0:1783946822.521434:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507230592 00000100:00100000:1.0:1783946822.521463:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 146 00000100:00100000:1.0:1783946822.521471:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507230720:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946822.521512:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507230720:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 42us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946822.521540:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 147 00000100:00080000:2.0:1783946822.521586:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946822.521794:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507230592:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946822.521955:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507230592:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 402us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946822.525787:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 146 00000100:00100000:3.0:1783946822.528301:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 147 00010000:00010000:1.0:1783946822.928424:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946823.268590:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946823.268767:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507230848 00000100:00100000:2.0:1783946823.268779:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507230848 00000100:00100000:2.0:1783946823.268880:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:2.0:1783946823.268892:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:10187:x1870603507230848:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946823.268920:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946823.269157:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db74ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e83 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.269259:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db74f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.269275:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db74f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.269290:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db74f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946823.269366:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783946823.269370:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783946823.269408:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db74f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.269457:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db74ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e83 expref: 7 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.269479:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db74f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e83 expref: 6 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.269489:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137a36ca700) 00010000:00010000:2.0:1783946823.269492:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783946823.269496:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622000, rc 0) 00000100:00100000:2.0:1783946823.269575:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:10187:x1870603507230848:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 684us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946823.269585:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:0.0:1783946823.302333:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946823.302462:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507230976 00000100:00100000:1.0:1783946823.302474:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507230976 00000100:00100000:1.0:1783946823.302555:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:1.0:1783946823.302566:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:10188:x1870603507230976:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783946823.302593:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946823.302632:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db74fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e8a expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303102:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303125:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303139:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303156:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303164:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303171:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303249:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45c00/0x229d2ec450db7510 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303278:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45c00/0x229d2ec450db7510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303287:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45c00/0x229d2ec450db7510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946823.303334:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783946823.303338:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783946823.303365:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45c00/0x229d2ec450db7510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303378:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303385:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303393:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303399:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946823.303403:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303410:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303422:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137a36ca700) 00010000:00010000:1.0:1783946823.303425:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946823.303430:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303446:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7502 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303463:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303469:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303474:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303480:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946823.303483:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303490:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303498:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9137927b9c00) 00010000:00010000:1.0:1783946823.303500:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946823.303503:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303509:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7509 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303547:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db74fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e8a expref: 8 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303561:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45c00/0x229d2ec450db7510 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e8a expref: 7 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946823.303575:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9137927b9f00) 00010000:00010000:1.0:1783946823.303577:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783946823.303580:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45c00, rc 0) 00000100:00100000:1.0:1783946823.303783:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:10188:x1870603507230976:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1217us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946823.303792:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1783946823.318685:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946823.327055:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507231232 00000100:00100000:2.0:1783946823.327094:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507231232 00000100:00100000:2.0:1783946823.327195:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:2.0:1783946823.327209:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:10188:x1870603507231232:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946823.327242:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946823.327272:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7517 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e91 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.327394:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.327411:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.327426:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.329111:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.329138:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.329152:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.329819:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151b000/0x229d2ec450db752c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.329834:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151b000/0x229d2ec450db752c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.329841:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151b000/0x229d2ec450db752c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946823.329853:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783946823.331875:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.331891:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.331898:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.331904:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151bc00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946823.333380:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333421:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333446:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9137927b9f00) 00010000:00010000:2.0:1783946823.333450:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946823.333456:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333462:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db751e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333486:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333493:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333499:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333505:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151ba00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946823.333507:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333513:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333521:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9137a36cae00) 00010000:00010000:2.0:1783946823.333524:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946823.333527:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.333545:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7525 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.335096:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7517 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e91 expref: 10 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.335122:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151b000/0x229d2ec450db752c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e91 expref: 9 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946823.335131:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:2.0:1783946823.335133:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946823.335137:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151b000, rc 0) 00000100:00100000:2.0:1783946823.335288:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:10188:x1870603507231232:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 8080us (16617us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783946823.335298:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:0.0:1783946823.351268:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946823.351376:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507231360 00000100:00100000:3.0:1783946823.351393:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507231360 00000100:00100000:3.0:1783946823.351488:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:3.0:1783946823.351502:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:10188:x1870603507231360:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783946823.351681:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:10188:x1870603507231360:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 Request processed in 175us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946823.351690:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00010000:00010000:0.0:1783946823.953887:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783946823.954675:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783946824.592472:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522998656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946824.592743:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946824.592826:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522998656 00000100:00100000:0.0:1783946824.592834:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522998656 00000100:00100000:0.0:1783946824.592890:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783946824.592900:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522998656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946824.592929:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946824.592969:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603522998656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946824.592976:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783946824.593017:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603522998656:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783946824.593043:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783946824.977736:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946825.616263:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522998784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946825.616346:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946825.616401:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522998912:0@lo:400:kworker.0 00000100:00100000:3.0:1783946825.616432:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946825.617677:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522999040:0@lo:400:kworker.0 00000100:00100000:1.0:1783946825.617745:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946825.621140:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522998784 00000100:00100000:0.0:1783946825.621150:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522998784 00000100:00100000:0.0:1783946825.621213:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783946825.621223:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522998784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946825.621514:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522998912 00000100:00100000:2.0:1783946825.621520:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522998912 00000100:00100000:2.0:1783946825.621554:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1783946825.621562:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522998912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946825.621661:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603522998912:12345-0@lo:400:kworker.0 Request processed in 99us (5227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946825.621669:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00002000:00000024:0.0:1783946825.621785:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946825.621827:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603522998784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 606us (5480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946825.621835:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783946825.621856:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522999040 00000100:00100000:0.0:1783946825.621861:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522999040 00000100:00100000:0.0:1783946825.621888:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783946825.621895:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522999040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946825.621931:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603522999040:12345-0@lo:400:kworker.0 Request processed in 36us (4186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946825.621938:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783946825.621971:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522999168:0@lo:400:kworker.0 00000100:00100000:0.0:1783946825.623441:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946825.623502:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946825.623513:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522999296:0@lo:400:kworker.0 00000100:00100000:0.0:1783946825.623559:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946825.623625:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603522999040:0@lo:400:kworker.0 00000100:00100000:0.0:1783946825.623643:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783946825.623648:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522999424:0@lo:400:kworker.0 00000100:00100000:0.0:1783946825.623673:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783946825.623701:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783946825.623722:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522999296 00000100:00100000:0.0:1783946825.623727:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522999296 00000100:00100000:0.0:1783946825.623770:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783946825.623778:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522999296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946825.623823:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603522999296:12345-0@lo:400:kworker.0 Request processed in 45us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946825.623830:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783946825.623850:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522999168 00000100:00100000:0.0:1783946825.623854:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522999168 00000100:00100000:0.0:1783946825.623878:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603522999424 00000100:00100000:0.0:1783946825.623881:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603522999424 00000100:00100000:0.0:1783946825.623904:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783946825.623910:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522999168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946825.623940:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603522999168:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946825.623946:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783946825.623957:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783946825.623970:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522999424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946825.624003:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603522999424:12345-0@lo:400:kworker.0 Request processed in 34us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946825.625227:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783946825.625500:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603522999296:0@lo:400:kworker.0 00000100:00100000:0.0:1783946825.625513:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603522999168:0@lo:400:kworker.0 00000100:00080000:0.0:1783946825.625538:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946825.625561:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603522999424:0@lo:400:kworker.0 00010000:00080000:3.0:1783946825.627839:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be49d500 x1870603522998784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946825.627872:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603522998784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946825.627886:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603522998912:0@lo:400:kworker.0 00010000:00010000:1.0:1783946826.003155:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946826.107017:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.108746:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507231488 00000100:00100000:2.0:1783946826.108762:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507231488 00000100:00080000:3.0:1783946826.108837:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946826.108862:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:2.0:1783946826.108875:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:10231:x1870603507231488:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946826.108911:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946826.108935:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db753a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e98 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109010:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109025:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109038:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109056:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109079:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109085:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109135:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109142:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109149:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109155:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151ae00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946826.109166:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109174:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109188:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137a36ca700) 00010000:00010000:2.0:1783946826.109191:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946826.109195:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109201:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109213:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109219:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109224:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109228:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151ba00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946826.109231:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109236:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109243:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91379793e700) 00010000:00010000:2.0:1783946826.109245:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946826.109253:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109259:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7548 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109291:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db753a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e98 expref: 10 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109301:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137a36ca700) 00010000:00010000:2.0:1783946826.109303:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946826.109306:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db753a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e98 expref: 10 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.109314:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151bc00, rc 0) 00000100:00100000:2.0:1783946826.109384:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:10231:x1870603507231488:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 512us (2377us total) trans 0 rc 301/301 00000100:00100000:2.0:1783946826.109393:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1783946826.132785:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946826.134919:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507231744 00000100:00100000:3.0:1783946826.134937:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507231744 00000100:00100000:3.0:1783946826.135024:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:3.0:1783946826.135036:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:10231:x1870603507231744:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:3.0:1783946826.135128:0:5956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946826.135165:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db74f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e83 expref: 9 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.135184:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137a36ca700) 00010000:00010000:3.0:1783946826.135195:0:5956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946826.135822:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.135840:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.135851:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.135884:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.135891:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.135899:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946826.136812:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783946826.136834:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.136843:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.136850:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.136856:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946826.136859:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.136867:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.137025:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:3.0:1783946826.137029:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946826.137034:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.137041:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db754f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783946826.137131:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000881182ef reply state 000000003e2b3355 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946826.137140:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783946826.137371:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:10231:x1870603507231744:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 2333us (4599us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783946826.137380:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00010000:00010000:3.0:1783946826.144704:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.144738:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.144746:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.144753:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946826.144758:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.144767:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.144787:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9137983e1900) 00010000:00010000:3.0:1783946826.144791:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946826.144796:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.144804:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7556 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946826.292840:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946826.293091:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507231872 00000100:00100000:1.0:1783946826.293102:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507231872 00000100:00100000:1.0:1783946826.293162:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:1.0:1783946826.293171:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:10239:x1870603507231872:12345-192.168.201.18@tcp:101:lctl.0 00010000:00010000:1.0:1783946826.293192:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946826.293215:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db755d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571e9f expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.293284:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7564 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.293297:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7564 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.293309:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7564 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946826.293375:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783946826.293379:0:7190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783946826.293415:0:7190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7564 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.293444:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db755d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e9f expref: 11 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.293463:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7564 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e9f expref: 10 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.293472:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:1.0:1783946826.293475:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783946826.293479:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44000, rc 0) 00000100:00100000:1.0:1783946826.293558:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:10239:x1870603507231872:12345-192.168.201.18@tcp:101:lctl.0 Request processed in 387us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946826.293566:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:3.0:1783946826.390825:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946826.390980:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507232000 00000100:00100000:0.0:1783946826.390991:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507232000 00000100:00100000:0.0:1783946826.391107:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:0.0:1783946826.391117:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:10245:x1870603507232000:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946826.391138:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946826.391159:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db756b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ea6 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391214:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391225:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391235:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391267:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391275:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391281:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391366:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db7580 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391372:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db7580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391377:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db7580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946826.391407:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783946826.391410:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946826.391435:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db7580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391444:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391448:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391453:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391463:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946826.391467:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391472:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391482:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:0.0:1783946826.391484:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946826.391487:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391490:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391499:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391503:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391507:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391509:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946826.391511:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391514:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391524:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9137be239200) 00010000:00010000:0.0:1783946826.391525:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946826.391527:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391530:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7579 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391551:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db756b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ea6 expref: 12 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391559:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db7580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ea6 expref: 11 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.391563:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:0.0:1783946826.391564:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783946826.391565:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8200, rc 0) 00000100:00100000:0.0:1783946826.391634:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:10245:x1870603507232000:12345-192.168.201.18@tcp:101:bash.0 Request processed in 518us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946826.391645:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:0.0:1783946826.398976:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946826.399264:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507232256 00000100:00100000:1.0:1783946826.399276:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507232256 00000100:00100000:1.0:1783946826.399332:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:1.0:1783946826.399343:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:10245:x1870603507232256:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1783946826.399366:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946826.399385:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7587 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ead expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.399490:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.399523:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.399547:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.399611:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.399620:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.399631:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783946826.400762:0:7190:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1783946826.401161:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401176:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401188:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401231:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401251:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401259:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401264:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946826.401269:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401276:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401288:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:2.0:1783946826.401291:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946826.401296:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401303:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db758e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946826.401318:0:7190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b87900b reply state 00000000cb0b08b9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946826.401326:0:7190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783946826.401363:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7587 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ead expref: 14 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401378:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ead expref: 13 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.401397:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91379793e700) 00010000:00010000:2.0:1783946826.401400:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946826.401402:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151bc00, rc 0) 00000100:00100000:2.0:1783946826.401560:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10245:x1870603507232256:12345-192.168.201.18@tcp:101:bash.0 Request processed in 2218us (2595us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783946826.401569:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00010000:00010000:0.0:1783946826.404295:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.404314:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.404322:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.404346:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946826.404352:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.404360:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.404377:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff913797609d00) 00010000:00010000:0.0:1783946826.404380:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946826.404385:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.404392:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7595 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946826.409647:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946826.409808:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507232384 00000100:00100000:1.0:1783946826.409819:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507232384 00000100:00100000:1.0:1783946826.409875:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:1.0:1783946826.409884:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1870603507232384:12345-192.168.201.18@tcp:8:bash.0 00010000:00080000:1.0:1783946826.409920:0:6945:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1783946826.409960:0:6945:0:(genops.c:1406:class_connect()) connect: client c2268401-da9f-4e1e-8a1c-9473caf67cba, cookie 0x229d2ec450db75aa 00002000:00100000:1.0:1783946826.409972:0:6945:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c2268401-da9f-4e1e-8a1c-9473caf67cba/ffff9137be509800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783946826.409988:0:6945:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783946826.410120:0:6945:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783946826.410152:0:6945:0:(import.c:65:import_set_state_nolock()) ffff9137be50b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783946826.410225:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2360:x1870603507232384:12345-192.168.201.18@tcp:8:bash.0 Request processed in 341us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946826.410245:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:1.0:1783946826.421131:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946826.421225:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507232512 00000100:00100000:0.0:1783946826.421246:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507232512 00000100:00100000:0.0:1783946826.421395:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:0.0:1783946826.421421:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:0:x1870603507232512:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946826.421443:0:6944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946826.421469:0:6944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571eb4 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783946826.421497:0:6944:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946826.421519:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=430s v=(0 0) 00010000:00010000:0.0:1783946826.421524:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946826.421540:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571eb4 expref: 7 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.421578:0:6944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571eb4 expref: 7 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.421602:0:6944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8e00, rc 0) 00000100:00100000:0.0:1783946826.421675:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:0:x1870603507232512:12345-192.168.201.18@tcp:101:bash.0 Request processed in 266us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946826.421689:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00080000:3.0:1783946826.421872:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783946826.426936:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946826.427159:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507232640 00000100:00100000:1.0:1783946826.427170:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507232640 00000100:00100000:1.0:1783946826.427233:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:1.0:1783946826.427244:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:10245:x1870603507232640:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1783946826.427263:0:6945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946826.427284:0:6945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ebb expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.427426:0:6945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571eb4 expref: 8 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.427438:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946826.427443:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946826.427449:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 8 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.428129:0:6945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eb4 expref: 8 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946826.428146:0:6945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eb4 expref: 8 pid: 6944 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946826.428161:0:6945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6945:1870603522999552:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783946826.429156:0:6945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be39b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946826.437383:0:6945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6945:1870603522999552:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946826.437434:0:6945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 8 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.437455:0:6945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45800, rc 0) 00000100:00100000:0.0:1783946826.437524:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:10245:x1870603507232640:12345-192.168.201.18@tcp:101:bash.0 Request processed in 10281us (10600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946826.437533:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:0.0:1783946826.442116:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.442318:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507232768 00000100:00100000:2.0:1783946826.442332:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507232768 00010000:00010000:2.0:1783946826.442383:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eb4 expref: 8 pid: 6944 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946826.442443:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:2.0:1783946826.442456:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507232768:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946826.442474:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946826.442505:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eb4 expref: 8 pid: 6944 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.442522:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eb4 expref: 8 pid: 6944 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.442552:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db75b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eb4 expref: 8 pid: 6944 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.442605:0:5942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946826.442610:0:5942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946826.442621:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 7 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.442632:0:5942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 7 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.442676:0:5942:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 7 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946826.442691:0:5942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5942:1870603522999680:192.168.201.18@tcp:105: 00000100:00100000:2.0:1783946826.442788:0:5942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4a00480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946826.447319:0:5942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5942:1870603522999680:192.168.201.18@tcp:105: 00010000:00010000:0.0:1783946826.447349:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946826.447464:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507232768:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 5010us (5402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946826.447476:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:1.0:1783946826.458314:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946826.458451:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507233024 00000100:00100000:3.0:1783946826.458461:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507233024 00000100:00100000:3.0:1783946826.458520:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1783946826.458529:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10245:x1870603507233024:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1783946826.460157:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10245:x1870603507233024:12345-192.168.201.18@tcp:35:bash.0 Request processed in 1618us (1846us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783946826.460174:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1783946826.611303:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946826.612938:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507233280 00000100:00100000:0.0:1783946826.612955:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507233280 00000100:00100000:0.0:1783946826.613039:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1783946826.613101:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10255:x1870603507233280:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946826.613129:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946826.613151:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db75bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ec2 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946826.613270:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783946826.613400:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db75bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ec2 expref: 16 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.613415:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:0.0:1783946826.613418:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783946826.613422:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db75bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ec2 expref: 16 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.613436:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8a00, rc 0) 00000100:00100000:0.0:1783946826.613526:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10255:x1870603507233280:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 429us (2234us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1783946826.613534:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1783946826.624203:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.625105:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507233536 00000100:00100000:2.0:1783946826.625118:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507233536 00000100:00100000:2.0:1783946826.625201:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1783946826.625212:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10255:x1870603507233536:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946826.625468:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:10255:x1870603507233536:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 257us (1278us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783946826.625477:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:1.0:1783946826.724442:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.734952:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507233664 00000100:00100000:2.0:1783946826.734985:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507233664 00000100:00100000:2.0:1783946826.735177:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:2.0:1783946826.735190:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:10261:x1870603507233664:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946826.735217:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946826.735254:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db75cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ec9 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.735327:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db75d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.735341:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db75d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.735354:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db75d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946826.735398:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783946826.735402:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783946826.735423:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db75d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.735463:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db75cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ec9 expref: 18 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.735485:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db75d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ec9 expref: 17 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.735494:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:2.0:1783946826.735496:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783946826.735500:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151ba00, rc 0) 00000100:00100000:2.0:1783946826.735602:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:10261:x1870603507233664:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 415us (11170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946826.735609:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:1.0:1783946826.743644:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946826.752836:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507233920 00000100:00100000:0.0:1783946826.754470:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507233920 00000100:00100000:0.0:1783946826.754615:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1783946826.754627:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:10261:x1870603507233920:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946826.754652:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946826.756502:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db75db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ed0 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.756824:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db75e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.756840:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db75e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.756854:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db75e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946826.756866:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783946826.756999:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db75db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ed0 expref: 20 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.757019:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db75e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ed0 expref: 19 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.757028:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91379793e700) 00010000:00010000:0.0:1783946826.757032:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946826.757036:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9800, rc 0) 00000100:00100000:0.0:1783946826.757124:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10261:x1870603507233920:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2498us (13512us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783946826.757133:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:1.0:1783946826.765820:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946826.765967:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507234048 00000100:00100000:0.0:1783946826.765977:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507234048 00000100:00100000:0.0:1783946826.766052:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:0.0:1783946826.766110:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:2363:x1870603507234048:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946826.766129:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946826.766167:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db75e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ed0 expref: 19 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.766186:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91379793e700) 00010000:00010000:0.0:1783946826.766191:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946826.766488:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2363:x1870603507234048:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 424us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946826.766496:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:1.0:1783946826.776774:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946826.777794:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507234304 00000100:00100000:3.0:1783946826.777808:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507234304 00000100:00100000:3.0:1783946826.777905:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:3.0:1783946826.777916:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:10261:x1870603507234304:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946826.777942:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946826.777963:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db75f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ed7 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.778122:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db75f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.778136:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db75f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.778148:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db75f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946826.778162:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783946826.778285:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db75f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ed7 expref: 21 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.778304:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db75f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ed7 expref: 20 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.778313:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91379793e700) 00010000:00010000:3.0:1783946826.778316:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783946826.778319:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030e00, rc 0) 00000100:00100000:3.0:1783946826.778376:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:10261:x1870603507234304:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 462us (1614us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783946826.778384:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:0.0:1783946826.800026:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.800185:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507234432 00000100:00100000:2.0:1783946826.800197:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507234432 00000100:00100000:2.0:1783946826.800275:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1783946826.800285:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507234432:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:2.0:1783946826.800335:0:6944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.800359:0:6944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 7 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.800369:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946826.800373:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783946826.800378:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.800418:0:6944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 7 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.800432:0:6944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 7 pid: 6945 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946826.800449:0:6944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6944:1870603522999808:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946826.800558:0:6944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4a00480 going to sleep for 11 seconds 00000100:00100000:2.0:1783946826.805386:0:6944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6944:1870603522999808:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946826.805423:0:6944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946826.806847:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.807045:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507234560 00000100:00100000:2.0:1783946826.807056:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507234560 00002000:00100000:2.0:1783946826.807163:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9137be694000 x1870603507234560/t0(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:372/0 lens 504/0 e 0 to 0 dl 1783946837 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783946826.807174:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be694000 with x1870603507234560 ext(0->12) 00010000:00010000:2.0:1783946826.807184:0:6948:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 8 pid: 6945 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.807199:0:6948:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 8 pid: 6945 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783946826.807205:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9137be694000 00000100:00100000:2.0:1783946826.807239:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1783946826.807249:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507234560:12345-192.168.201.18@tcp:4:lfs.0 00000001:00100000:1.0:1783946826.813508:0:8015:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000100:00100000:2.0:1783946826.820464:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2362:x1870603507234560:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 13202us (13611us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783946826.820480:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00002000:00100000:2.0:1783946826.820493:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9137be694000 x1870603507234560/t4294967299(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:372/0 lens 504/448 e 0 to 0 dl 1783946837 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783946826.820503:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be694000 with x1870603507234560 ext(0->12) 00010000:00010000:2.0:1783946826.820514:0:6948:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 9 pid: 6945 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.820551:0:6948:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 9 pid: 6945 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783946826.820559:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9137be694000 00000100:00100000:1.0:1783946826.826529:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.826821:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507234688 00000100:00100000:2.0:1783946826.826833:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507234688 00010000:00010000:2.0:1783946826.826884:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 9 pid: 6945 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946826.826933:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:2.0:1783946826.826943:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2364:x1870603507234688:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946826.826960:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783946826.826979:0:8023:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783946826.826983:0:8023:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783946826 00002000:00010000:2.0:1783946826.826985:0:8023:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783946826 00002000:00010000:2.0:1783946826.826988:0:8023:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783946826 00002000:00010000:2.0:1783946826.826990:0:8023:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783946826.826996:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 9 pid: 6945 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827010:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 9 pid: 6945 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827033:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db75b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ebb expref: 9 pid: 6945 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827099:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783946826.827104:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783946826.827111:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827121:0:8023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827149:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946826.827206:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2364:x1870603507234688:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 263us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946826.827215:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00010000:00010000:2.0:1783946826.827259:0:6944:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827269:0:6944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827291:0:6944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827300:0:6944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827309:0:6944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827323:0:6944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151ae00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946826.827328:0:6944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827337:0:6944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827351:0:6944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.827358:0:6944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2775efe/0x229d2ec450db7605 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946826.835934:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507234432:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 35630us (35899us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946826.835953:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1783946826.844152:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946826.844784:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507234944 00000100:00100000:3.0:1783946826.844827:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507234944 00000100:00100000:3.0:1783946826.844928:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1783946826.844943:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:10261:x1870603507234944:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:3.0:1783946826.845031:0:5960:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db75f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ed7 expref: 20 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783946826.845542:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1783946826.845697:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1783946826.848435:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1783946826.848548:0:5960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.848576:0:5960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ead expref: 24 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.848832:0:5960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.848967:0:5960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ead expref: 24 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.848989:0:5960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ead expref: 24 pid: 7190 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946826.849008:0:5960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5960:1870603522999936:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946826.849797:0:5960:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7540 going to sleep for 11 seconds 00000100:00100000:1.0:1783946826.854572:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.854883:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507235072 00000100:00100000:2.0:1783946826.854896:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507235072 00010000:00010000:2.0:1783946826.854956:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ead expref: 25 pid: 7190 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946826.855014:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:2.0:1783946826.855028:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+25:2361:x1870603507235072:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946826.855048:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946826.855102:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ead expref: 25 pid: 7190 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.855118:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ead expref: 25 pid: 7190 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.855160:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91379793e700) 00010000:00010000:2.0:1783946826.855166:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.855179:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.855188:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.855212:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946826.855297:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+25:2361:x1870603507235072:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 271us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946826.855306:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00010000:00010000:3.0:1783946826.856052:0:5960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db759c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ead expref: 24 pid: 7190 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946826.856115:0:5960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5960:1870603522999936:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946826.856143:0:5960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.856153:0:5960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.856159:0:5960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783946826.856401:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1783946826.856543:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1783946826.856904:0:5960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5960:1870603523000064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783946826.856992:0:5960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946826.857052:0:5960:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946826.857681:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523000064 00000100:00100000:2.0:1783946826.857691:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523000064 00000100:00100000:2.0:1783946826.857753:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946826.857764:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5960:x1870603523000064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783946826.857912:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5960:x1870603523000064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946826.857920:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946826.858749:0:5960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5960:1870603523000064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783946826.858976:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1783946826.859099:0:5960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5960:1870603523000192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783946826.859158:0:5960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946826.859184:0:5960:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f46180 going to sleep for 11 seconds 00000100:00100000:3.0:1783946826.859394:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523000192 00000100:00100000:3.0:1783946826.859400:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523000192 00000100:00100000:3.0:1783946826.859445:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783946826.859455:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5960:x1870603523000192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783946826.859623:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5960:x1870603523000192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (455us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783946826.859631:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946826.859805:0:5960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5960:1870603523000192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783946826.859853:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1783946826.859892:0:5960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.859903:0:5960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.859911:0:5960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.859919:0:5960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946826.859924:0:5960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.859932:0:5960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.859951:0:5960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91379793e700) 00010000:00010000:2.0:1783946826.859954:0:5960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783946826.859960:0:5960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.859967:0:5960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db760c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783946826.860202:0:5960:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783946826.860443:0:5960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1783946826.860471:0:5960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 430779410217ns, next at 431779407275ns, rc = 0 00000001:00080000:2.0:1783946826.860480:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1783946826.860506:0:5960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91379793e700) 00010000:00010000:2.0:1783946826.860510:0:5960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783946826.860519:0:5960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db75f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ed7 expref: 28 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946826.861145:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+27:10261:x1870603507234944:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 16203us (17000us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783946826.861156:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000020:00080000:2.0:1783946826.861162:0:5960:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783946826.864133:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946826.864734:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507235200 00000100:00100000:3.0:1783946826.864751:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507235200 00000100:00100000:3.0:1783946826.864846:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:3.0:1783946826.864860:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+27:10261:x1870603507235200:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946826.864914:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946826.864948:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7613 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ede expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.865031:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7613 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ede expref: 28 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.865051:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7613 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ede expref: 28 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946826.865206:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:3.0:1783946826.865209:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783946826.865213:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030800, rc 0) 00000100:00100000:3.0:1783946826.865515:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:10261:x1870603507235200:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 656us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946826.865523:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1783946826.881100:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946826.881251:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507235456 00000100:00100000:3.0:1783946826.881264:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507235456 00000100:00100000:3.0:1783946826.881342:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783946826.881354:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3483850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:10261:x1870603507235456:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1783946826.882157:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3483850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:10261:x1870603507235456:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 800us (1093us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1783946826.882168:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1783946826.969924:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946826.970119:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507235712 00000100:00100000:3.0:1783946826.970142:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507235712 00000100:00100000:0.0:1783946826.970330:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:0.0:1783946826.970346:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:10271:x1870603507235712:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946826.970379:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946826.970407:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db761a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ee5 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946826.970561:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783946826.970717:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db761a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ee5 expref: 31 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.970735:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:0.0:1783946826.970739:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783946826.970745:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db761a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ee5 expref: 31 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946826.970763:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8600, rc 0) 00000100:00100000:0.0:1783946826.970847:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+30:10271:x1870603507235712:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 506us (938us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1783946826.970856:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:0.0:1783946826.973843:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.973957:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507235840 00000100:00100000:2.0:1783946826.973970:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507235840 00000100:00100000:2.0:1783946826.974046:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:2.0:1783946826.974100:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+30:10271:x1870603507235840:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1783946826.974211:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974244:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974259:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974279:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974287:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974303:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974416:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974424:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974432:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946826.974513:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974529:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974537:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974544:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974551:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151bc00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946826.974556:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974565:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974579:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:2.0:1783946826.974597:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946826.974604:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974680:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7628 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974700:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974707:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974713:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974718:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151ae00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946826.974721:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974727:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974735:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91379793e700) 00010000:00010000:2.0:1783946826.974738:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946826.974741:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974747:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db762f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974766:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974782:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974788:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974793:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946826.974796:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974802:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974810:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946826.974812:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946826.974815:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946826.974821:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946826.974990:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+30:10271:x1870603507235840:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 931us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946826.975000:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:1.0:1783946826.978638:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946826.978845:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507236096 00000100:00100000:2.0:1783946826.978928:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507236096 00000100:00100000:2.0:1783946826.979006:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1783946826.979019:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+30:10271:x1870603507236096:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946826.979810:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:10271:x1870603507236096:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 788us (1189us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1783946826.979841:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1783946827.007938:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946827.008096:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507236352 00000100:00100000:0.0:1783946827.008108:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507236352 00000100:00100000:0.0:1783946827.008203:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:0.0:1783946827.008215:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:10274:x1870603507236352:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946827.008258:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946827.008288:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9200/0x229d2ec450db763d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571eec expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008388:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008404:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008417:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008432:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008438:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008444:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008612:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008621:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008649:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946827.008661:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783946827.008754:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008762:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008769:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008774:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946827.008779:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008788:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008802:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:0.0:1783946827.008805:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946827.008810:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008816:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7644 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008831:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008838:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008849:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008854:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946827.008858:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008865:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008871:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137be239600) 00010000:00010000:0.0:1783946827.008874:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946827.008877:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008883:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db764b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008927:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9200/0x229d2ec450db763d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571eec expref: 34 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008942:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571eec expref: 33 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.008950:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946827.008952:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946827.008955:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9000, rc 0) 00000100:00100000:0.0:1783946827.009039:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:10274:x1870603507236352:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 826us (1117us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1783946827.009055:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:0.0:1783946827.013151:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946827.013280:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507236480 00000100:00100000:2.0:1783946827.013294:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507236480 00000100:00100000:2.0:1783946827.013374:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:2.0:1783946827.013388:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:10274:x1870603507236480:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1783946827.013502:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.013526:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.013540:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.013597:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.013605:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.013612:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.013618:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946827.013623:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.013632:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.013645:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946827.013666:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946827.013672:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.013678:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db7660 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946827.013778:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:10274:x1870603507236480:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 393us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946827.013789:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:1.0:1783946827.016805:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946827.016966:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507236736 00000100:00100000:3.0:1783946827.016997:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507236736 00000100:00100000:3.0:1783946827.017092:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1783946827.017106:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:10274:x1870603507236736:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1783946827.017436:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+34:10274:x1870603507236736:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 331us (641us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1783946827.017444:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00010000:00010000:1.0:1783946827.028120:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946827.321158:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946827.321347:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507236992 00000100:00100000:3.0:1783946827.321360:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507236992 00000100:00100000:3.0:1783946827.321435:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:3.0:1783946827.321447:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+34:10305:x1870603507236992:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1783946827.321492:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946827.321519:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7667 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ef3 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.321682:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db766e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.321701:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db766e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.321717:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db766e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946827.321731:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783946827.322125:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7667 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ef3 expref: 37 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.322149:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db766e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ef3 expref: 36 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.322182:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:3.0:1783946827.322185:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946827.322190:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030000, rc 0) 00000100:00100000:3.0:1783946827.322399:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:10305:x1870603507236992:12345-192.168.201.18@tcp:101:cat.0 Request processed in 952us (1255us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1783946827.322408:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:1.0:1783946827.338085:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946827.338139:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507237248 00000100:00100000:1.0:1783946827.338144:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946827.338153:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507237248 00000100:00100000:2.0:1783946827.338311:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507237376 00000100:00100000:2.0:1783946827.338316:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507237376 00000100:00100000:2.0:1783946827.338380:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:2.0:1783946827.338393:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3532850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:2363:x1870603507237376:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946827.338414:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946827.338448:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db766e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ef3 expref: 37 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.338475:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946827.338481:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946827.338550:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3532850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:2363:x1870603507237376:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 159us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946827.338559:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:3.0:1783946827.338787:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1783946827.338798:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:10305:x1870603507237248:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:0.0:1783946827.341316:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:10305:x1870603507237248:12345-192.168.201.18@tcp:35:cat.0 Request processed in 2503us (3251us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1783946827.341335:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1783946827.441933:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946827.442114:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507237632 00000100:00100000:2.0:1783946827.442129:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507237632 00000100:00100000:2.0:1783946827.442200:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:2.0:1783946827.442228:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:10311:x1870603507237632:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:2.0:1783946827.442263:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946827.445657:0:5958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783946827.445719:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db75d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ec9 expref: 36 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.445748:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:2.0:1783946827.445754:0:5958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946827.445777:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db767c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571efa expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.445897:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.445914:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571eec expref: 36 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.445923:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.446481:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eec expref: 36 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.446506:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eec expref: 36 pid: 7190 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946827.446525:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523000320:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946827.447000:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946827.451320:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523000320:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946827.451357:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946827.451944:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946827.452309:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507237760 00000100:00100000:2.0:1783946827.452320:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507237760 00010000:00010000:2.0:1783946827.452364:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eec expref: 37 pid: 7190 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946827.452416:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:2.0:1783946827.452428:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be695180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:2361:x1870603507237760:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946827.452449:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946827.452457:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eec expref: 37 pid: 7190 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.452470:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eec expref: 37 pid: 7190 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.452493:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7652 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571eec expref: 37 pid: 7190 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.452510:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946827.452515:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.452525:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.452533:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.452585:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946827.452848:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.452856:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946827.452874:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783946827.453056:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622000/0x229d2ec450db767c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571efa expref: 38 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.453112:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571efa expref: 37 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.453123:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:3.0:1783946827.453126:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783946827.453128:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622400, rc 0) 00000100:00100000:2.0:1783946827.453260:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be695180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:2361:x1870603507237760:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 833us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946827.453268:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:3.0:1783946827.464052:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:10311:x1870603507237632:12345-192.168.201.18@tcp:101:dd.0 Request processed in 21818us (22113us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783946827.464098:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:3.0:1783946827.469770:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946827.470786:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507237888 00000100:00100000:2.0:1783946827.470803:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507237888 00000100:00100000:2.0:1783946827.470887:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1783946827.470899:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:10311:x1870603507237888:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:2.0:1783946827.470937:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946827.470966:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7691 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f01 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.471012:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.471031:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.471047:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.471392:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db7691 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f01 expref: 38 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.471413:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f01 expref: 37 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.471423:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946827.471427:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783946827.471431:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151ae00, rc 0) 00000100:00100000:2.0:1783946827.471536:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:10311:x1870603507237888:12345-192.168.201.18@tcp:101:dd.0 Request processed in 633us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946827.471544:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:1.0:1783946827.474490:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946827.474681:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507238144 00000100:00100000:0.0:1783946827.474697:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507238144 00000100:00100000:0.0:1783946827.474778:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:0.0:1783946827.474792:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:10311:x1870603507238144:12345-192.168.201.18@tcp:36:dd.0 00010000:00010000:0.0:1783946827.475177:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.475205:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.475220:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783946827.475279:0:5956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1783946827.475305:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0bb7bec reply state 00000000a3437e5b transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946827.475317:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783946827.475445:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+40:10311:x1870603507238144:12345-192.168.201.18@tcp:36:dd.0 Request processed in 655us (968us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1783946827.475480:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000020:00080000:0.0:1783946827.475486:0:5956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783946827.482752:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.482778:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.482788:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.482797:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946827.482802:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.482810:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.482834:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:3.0:1783946827.482838:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946827.482843:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.482850:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db769f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946827.632704:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946827.632759:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946827.632805:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946827.632967:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507238272 00000100:00100000:0.0:1783946827.632982:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507238272 00000100:00100000:0.0:1783946827.633110:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 295 00000100:00100000:0.0:1783946827.633122:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507238272:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946827.633236:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507238272:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 117us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946827.633246:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 295 00000100:00100000:3.0:1783946827.633861:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507238400 00000100:00100000:3.0:1783946827.633869:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507238400 00000100:00100000:3.0:1783946827.633927:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:3.0:1783946827.633937:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507238400:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946827.634009:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507238400:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 75us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946827.634017:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:2.0:1783946827.634250:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507238528 00000100:00100000:2.0:1783946827.634256:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507238528 00000100:00100000:2.0:1783946827.634325:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 151 00000100:00100000:2.0:1783946827.634334:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507238528:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946827.634371:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507238528:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 38us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946827.634378:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 151 00000100:00080000:3.0:1783946827.634995:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946827.775399:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946827.775733:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507238656 00000100:00100000:3.0:1783946827.775748:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507238656 00000100:00100000:3.0:1783946827.775841:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:3.0:1783946827.775853:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+39:10325:x1870603507238656:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:3.0:1783946827.775903:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946827.775941:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db76a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f08 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776030:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776049:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776103:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776123:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776131:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776139:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776260:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776273:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571efa expref: 40 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776283:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776330:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571efa expref: 40 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.776346:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571efa expref: 40 pid: 5958 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946827.776364:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523000448:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946827.776507:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7600 going to sleep for 11 seconds 00000100:00100000:0.0:1783946827.780239:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946827.780430:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507238912 00000100:00100000:1.0:1783946827.780443:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507238912 00000100:00100000:1.0:1783946827.780516:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1783946827.780528:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:5450:x1870603507238912:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783946827.781403:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:5450:x1870603507238912:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 871us (1173us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1783946827.781436:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1783946827.781594:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523000448:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946827.781710:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946827.789852:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946827.795019:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507239040 00000100:00100000:2.0:1783946827.795189:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507239040 00010000:00010000:2.0:1783946827.795329:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571efa expref: 42 pid: 5958 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946827.795430:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:2.0:1783946827.795444:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:2361:x1870603507239040:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946827.795470:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946827.795479:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571efa expref: 42 pid: 5958 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.795494:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571efa expref: 42 pid: 5958 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.795522:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622400/0x229d2ec450db7683 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571efa expref: 42 pid: 5958 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.795581:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946827.795588:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.795610:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.795620:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.795660:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946827.795760:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:2361:x1870603507239040:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 320us (5929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946827.795769:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00010000:00010000:3.0:1783946827.797499:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797521:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946827.797619:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783946827.797646:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946827.797705:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797726:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797739:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797746:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797754:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797760:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946827.797765:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797773:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797791:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946827.797795:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946827.797801:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797808:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db76ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797829:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797845:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797851:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797855:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946827.797869:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797875:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797883:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137983e1d00) 00010000:00010000:3.0:1783946827.797886:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946827.797889:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797894:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db76b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797969:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db76a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f08 expref: 41 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797988:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f08 expref: 40 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946827.797997:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:3.0:1783946827.797999:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946827.798008:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030600, rc 0) 00000100:00100000:3.0:1783946827.798719:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+40:10325:x1870603507238656:12345-192.168.201.18@tcp:101:stat.0 Request processed in 22860us (23326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946827.798732:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:1.0:1783946827.860532:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946827.860669:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507239296 00000100:00100000:2.0:1783946827.860685:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507239296 00000100:00100000:2.0:1783946827.860775:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:2.0:1783946827.860790:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+40:10331:x1870603507239296:12345-192.168.201.18@tcp:36:truncate.0 00010000:00010000:2.0:1783946827.860889:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946827.860928:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db76bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f08 expref: 40 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.860958:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946827.860964:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946827.861302:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.861321:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946827.861354:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783946827.861410:0:7190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1783946827.861440:0:7190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016fa28a8 reply state 00000000ff7702ee transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946827.861453:0:7190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783946827.861635:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:10331:x1870603507239296:12345-192.168.201.18@tcp:36:truncate.0 Request processed in 847us (1117us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1783946827.861643:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000020:00080000:2.0:1783946827.861651:0:7190:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783946827.863845:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.863866:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.863876:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.863883:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151bc00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946827.863889:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.863898:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.863918:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946827.863922:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946827.863928:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.863951:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946827.978515:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946827.978640:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507239424 00000100:00100000:0.0:1783946827.978656:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507239424 00000100:00100000:0.0:1783946827.978746:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:0.0:1783946827.978762:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:10345:x1870603507239424:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:0.0:1783946827.978796:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946827.978826:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db76c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f0f expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.978931:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.978950:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.978965:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.978982:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.978990:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.978996:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979133:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979168:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979175:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946827.979245:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1783946827.979251:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946827.979280:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979294:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979304:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979312:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979319:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979326:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946827.979330:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979338:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979352:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:0.0:1783946827.979361:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946827.979368:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979375:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db76d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979393:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979399:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979404:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979410:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946827.979413:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979420:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979427:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137be239600) 00010000:00010000:0.0:1783946827.979429:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946827.979432:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979438:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979477:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db76c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f0f expref: 43 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979507:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f0f expref: 42 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946827.979516:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946827.979518:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946827.979521:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8400, rc 0) 00000100:00100000:0.0:1783946827.979616:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:10345:x1870603507239424:12345-192.168.201.18@tcp:101:stat.0 Request processed in 858us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946827.979626:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00010000:00010000:1.0:1783946828.048489:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946828.057024:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946828.057376:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507239680 00000100:00100000:2.0:1783946828.057388:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507239680 00000100:00100000:2.0:1783946828.057485:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:2.0:1783946828.057497:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:10355:x1870603507239680:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946828.057529:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946828.057560:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f16 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946828.057724:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783946828.059052:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f16 expref: 44 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.059093:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:2.0:1783946828.059098:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946828.059104:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db76e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f16 expref: 44 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.059154:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151bc00, rc 0) 00000100:00100000:2.0:1783946828.059385:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+43:10355:x1870603507239680:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1888us (2375us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1783946828.059397:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00080000:3.0:1783946828.059557:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946828.063576:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946828.063762:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507239936 00000100:00100000:2.0:1783946828.063776:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507239936 00000100:00100000:2.0:1783946828.063954:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:2.0:1783946828.063968:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+43:10355:x1870603507239936:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946828.064411:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+44:10355:x1870603507239936:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 445us (862us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1783946828.064419:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:1.0:1783946828.133455:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946828.133621:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507240192 00000100:00100000:0.0:1783946828.133635:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507240192 00000100:00100000:0.0:1783946828.133723:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:0.0:1783946828.133736:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+44:10361:x1870603507240192:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946828.133774:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946828.133807:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db76f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f1d expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.133968:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.133988:0:5956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f0f expref: 45 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.133998:0:5956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.134044:0:5956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f0f expref: 45 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.134131:0:5956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f0f expref: 45 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946828.134151:0:5956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be694a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523000576:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946828.134289:0:5956:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f35600 going to sleep for 11 seconds 00000100:00100000:1.0:1783946828.137303:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946828.137535:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507240320 00000100:00100000:3.0:1783946828.137547:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507240320 00010000:00010000:3.0:1783946828.137621:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f0f expref: 46 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946828.137676:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:3.0:1783946828.137688:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+46:2362:x1870603507240320:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946828.137708:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946828.137716:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f0f expref: 46 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.137730:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f0f expref: 46 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.137763:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:3.0:1783946828.137769:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.137783:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.137792:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.137814:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946828.137903:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+46:2362:x1870603507240320:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 217us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946828.137913:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00010000:00010000:0.0:1783946828.139019:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db76de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f0f expref: 45 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946828.139046:0:5956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be694a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523000576:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946828.139129:0:5956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.139143:0:5956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.139151:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946828.139177:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1783946828.139527:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db76f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f1d expref: 46 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.139547:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f1d expref: 45 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.139556:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946828.139585:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783946828.139822:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9800, rc 0) 00000100:00100000:0.0:1783946828.139906:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+45:10361:x1870603507240192:12345-192.168.201.18@tcp:101:bash.0 Request processed in 6172us (6470us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1783946828.139916:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:1.0:1783946828.143303:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946828.143412:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507240576 00000100:00100000:2.0:1783946828.143426:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507240576 00000100:00100000:2.0:1783946828.143506:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:2.0:1783946828.143519:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+45:10361:x1870603507240576:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:2.0:1783946828.143881:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.143904:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.143918:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783946828.143979:0:5957:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1783946828.144034:0:5957:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d4fb9b5 reply state 000000006bda5c8d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946828.144051:0:5957:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783946828.144208:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+48:10361:x1870603507240576:12345-192.168.201.18@tcp:36:bash.0 Request processed in 691us (920us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1783946828.144218:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000020:00080000:2.0:1783946828.144224:0:5957:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783946828.146017:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.146036:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.146044:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.146051:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151bc00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946828.146057:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.146092:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.146111:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946828.146114:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946828.146119:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.146126:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7708 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946828.150796:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946828.151377:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507240704 00000100:00100000:3.0:1783946828.151393:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507240704 00000100:00100000:3.0:1783946828.151475:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:3.0:1783946828.151486:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:10361:x1870603507240704:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1783946828.151513:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946828.151543:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db770f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f24 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.151701:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.151718:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f1d expref: 48 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.151729:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.152925:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f1d expref: 48 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.152954:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f1d expref: 48 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946828.152975:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523000704:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946828.153139:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783946828.155981:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523000704:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783946828.156027:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946828.158613:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946828.158849:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507240832 00000100:00100000:0.0:1783946828.158875:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507240832 00010000:00010000:0.0:1783946828.158933:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f1d expref: 49 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946828.159010:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1783946828.159022:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:2361:x1870603507240832:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946828.159047:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946828.159055:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f1d expref: 49 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.159111:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f1d expref: 49 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.159139:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db76fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f1d expref: 49 pid: 5956 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.159161:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946828.159168:0:5942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.159179:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.159188:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.159223:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946828.159299:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+48:2361:x1870603507240832:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 278us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946828.159308:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00010000:00010000:1.0:1783946828.159793:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.159806:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946828.160108:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783946828.160114:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783946828.160152:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.160214:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db770f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f24 expref: 48 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.160261:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f24 expref: 47 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.160270:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:1.0:1783946828.160274:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783946828.160277:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031800, rc 0) 00000100:00100000:1.0:1783946828.160327:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:10361:x1870603507240704:12345-192.168.201.18@tcp:101:bash.0 Request processed in 8843us (9548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946828.160336:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:3.0:1783946828.163606:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946828.163799:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507241088 00000100:00100000:0.0:1783946828.163833:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507241088 00000100:00100000:2.0:1783946828.164742:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:2.0:1783946828.164763:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3480050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:10361:x1870603507241088:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1783946828.165178:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3480050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+48:10361:x1870603507241088:12345-192.168.201.18@tcp:35:bash.0 Request processed in 421us (1593us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1783946828.165188:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1783946828.262677:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946828.262897:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507241344 00000100:00100000:2.0:1783946828.262912:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507241344 00000100:00100000:2.0:1783946828.263003:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:2.0:1783946828.263016:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+48:10371:x1870603507241344:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946828.263051:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946828.263130:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db771d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f2b expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946828.263281:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783946828.263430:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db771d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f2b expref: 50 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.263451:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:2.0:1783946828.263455:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946828.263462:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db771d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f2b expref: 50 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.263502:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151ba00, rc 0) 00000100:00100000:2.0:1783946828.263622:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:10371:x1870603507241344:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 608us (957us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1783946828.263632:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:3.0:1783946828.267515:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946828.267661:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507241472 00000100:00100000:0.0:1783946828.267674:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507241472 00000100:00100000:0.0:1783946828.267755:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:0.0:1783946828.267766:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:10371:x1870603507241472:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:0.0:1783946828.267901:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.267932:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.267948:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.267966:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.267974:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.267980:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268107:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268117:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268125:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783946828.268192:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268243:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268250:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268258:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268265:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946828.268270:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268279:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268293:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:0.0:1783946828.268296:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946828.268302:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268308:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db772b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268324:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268330:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268335:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268346:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946828.268349:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268355:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268361:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137be239600) 00010000:00010000:0.0:1783946828.268364:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946828.268366:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268372:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7732 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268386:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268393:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268398:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268404:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946828.268406:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268412:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268431:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946828.268433:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946828.268436:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.268442:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7739 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946828.268546:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:10371:x1870603507241472:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 780us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946828.268555:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:1.0:1783946828.273158:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946828.273274:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507241728 00000100:00100000:2.0:1783946828.273289:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507241728 00000100:00100000:2.0:1783946828.273369:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1783946828.273382:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:10371:x1870603507241728:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946828.273709:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:10371:x1870603507241728:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 328us (568us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1783946828.273718:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1783946828.301821:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946828.301881:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507241984 00000100:00100000:2.0:1783946828.301895:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507241984 00000100:00100000:3.0:1783946828.306622:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:3.0:1783946828.306653:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:10374:x1870603507241984:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946828.306692:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946828.306725:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7740 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f32 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.306841:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.307467:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.307488:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.307512:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.307520:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.307527:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.307693:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7755 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.307730:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.307737:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946828.307752:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783946828.308143:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308281:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308289:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308296:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946828.308301:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308310:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308325:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946828.308329:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946828.308335:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308341:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7747 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308360:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308375:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308381:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308385:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946828.308388:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308395:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308403:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137983e1d00) 00010000:00010000:3.0:1783946828.308406:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946828.308409:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308414:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db774e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308490:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7740 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f32 expref: 53 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308508:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f32 expref: 52 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.308517:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:3.0:1783946828.308520:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946828.308530:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030600, rc 0) 00000100:00100000:3.0:1783946828.308751:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:10374:x1870603507241984:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2110us (6943us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1783946828.308763:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:3.0:1783946828.314052:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946828.314162:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946828.314276:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507242240 00000100:00100000:0.0:1783946828.314289:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507242240 00000100:00100000:1.0:1783946828.314324:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507242112 00000100:00100000:1.0:1783946828.314329:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507242112 00000100:00100000:1.0:1783946828.314377:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:1.0:1783946828.314390:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+53:10374:x1870603507242112:12345-192.168.201.18@tcp:54:lfs.0 00000100:00100000:0.0:1783946828.314437:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:0.0:1783946828.314446:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+53:2363:x1870603507242240:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946828.314469:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946828.314505:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f32 expref: 53 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.314529:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:1.0:1783946828.314530:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.314536:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783946828.314547:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.314570:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946828.314626:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:2363:x1870603507242240:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 181us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946828.314636:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00010000:00010000:1.0:1783946828.314702:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.314711:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.314739:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.314745:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946828.314751:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.314760:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.314768:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:1.0:1783946828.314772:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783946828.314776:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.314783:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7763 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946828.314839:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+51:10374:x1870603507242112:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 452us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946828.314847:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:3.0:1783946828.316914:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946828.317109:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507242496 00000100:00100000:1.0:1783946828.317122:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507242496 00000100:00100000:1.0:1783946828.317189:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1783946828.317202:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+51:10374:x1870603507242496:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1783946828.317503:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:10374:x1870603507242496:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 302us (601us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1783946828.317511:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1783946828.535248:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946828.536707:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507242752 00000100:00100000:2.0:1783946828.536730:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507242752 00000100:00100000:2.0:1783946828.536834:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:2.0:1783946828.536847:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:10392:x1870603507242752:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:2.0:1783946828.536890:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946828.536937:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db776a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f39 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.537114:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7771 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.537134:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7771 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.537182:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7771 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946828.537199:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783946828.537373:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db776a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f39 expref: 55 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.537398:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7771 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f39 expref: 54 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.537406:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946828.537409:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783946828.537413:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151bc00, rc 0) 00000100:00100000:2.0:1783946828.537517:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:10392:x1870603507242752:12345-192.168.201.18@tcp:101:cat.0 Request processed in 673us (2285us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1783946828.537526:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00000001:00080000:1.0:1783946828.541668:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:1.0:1783946828.541743:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1783946828.547771:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be54ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523000832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783946828.547904:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946828.548333:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523000832 00000100:00100000:3.0:1783946828.548345:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523000832 00000100:00100000:3.0:1783946828.548432:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783946828.548443:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3448:x1870603523000832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783946828.548487:0:6942:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1783946828.548534:0:6942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a54de4a, atime: 0x6a54de4a, ctime: 0x6a54de4a, blocks: 0x8 00010000:00010000:3.0:1783946828.548544:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.548576:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1783946828.548582:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946828.548600:0:6942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.548621:0:6942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.548632:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.548653:0:6942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.548681:0:6942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946828.548854:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946828.548865:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.548875:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946828.548881:0:5945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.548891:0:5945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946828.548902:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3448:x1870603523000832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 460us (998us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783946828.548910:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1783946828.548939:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946828.548950:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000782c37ea/0x229d2ec450db777f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783946828.549380:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1783946828.549432:0:3448:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be54ad80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1783946828.549441:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be54ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523000832:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783946828.549501:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946828.549503:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946828.549505:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783946828.551046:0:5935:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9137a4a00540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1783946828.551077:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137be499800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9137a4a000c0 00000020:00080000:1.0:1783946828.551081:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137be499e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9137bddcac00 00000020:00080000:0.0:1783946828.551517:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1783946828.551815:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783946828.567767:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946828.567982:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507242880 00000100:00100000:3.0:1783946828.567998:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507242880 00000100:00100000:3.0:1783946828.568138:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:3.0:1783946828.568153:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10393:x1870603507242880:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946828.568206:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946828.568245:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7786 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f40 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.568362:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db778d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.568382:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db778d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.568398:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db778d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946828.568472:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783946828.568497:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946828.568528:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db778d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.568572:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7786 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f40 expref: 15 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.568605:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db778d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f40 expref: 14 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.568618:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946828.568622:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946828.568626:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031200, rc 0) 00000100:00100000:3.0:1783946828.568711:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10393:x1870603507242880:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 562us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946828.568719:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:0.0:1783946828.581961:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946828.582168:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507243264 00000100:00100000:1.0:1783946828.582186:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507243264 00000100:00100000:1.0:1783946828.582284:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1783946828.582297:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10393:x1870603507243264:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1783946828.582831:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10393:x1870603507243264:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 533us (890us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1783946828.582841:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1783946828.589633:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946828.589955:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507243392 00000100:00100000:1.0:1783946828.589968:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507243392 00000100:00100000:1.0:1783946828.590156:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:1.0:1783946828.590171:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10393:x1870603507243392:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:1.0:1783946828.590196:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783946828.590239:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f24 expref: 15 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.590275:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7771 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f39 expref: 14 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.590292:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7613 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ede expref: 13 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946828.590333:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:1.0:1783946828.590340:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946828.590406:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:10393:x1870603507243392:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 238us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946828.590415:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1783946828.593472:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946828.594156:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507243520 00000100:00100000:0.0:1783946828.594174:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507243520 00000100:00100000:0.0:1783946828.594359:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:0.0:1783946828.594372:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:10393:x1870603507243520:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:0.0:1783946828.594578:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.594611:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946828.594627:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783946828.595029:0:7190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783946828.595482:0:7190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1783946828.595644:0:7190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1783946828.595795:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:10393:x1870603507243520:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 1419us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946828.595809:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:0.0:1783946828.616742:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946828.617399:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507243648 00000100:00100000:3.0:1783946828.617417:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507243648 00000100:00100000:3.0:1783946828.617570:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:3.0:1783946828.617592:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:10395:x1870603507243648:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946828.617624:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946828.617658:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db779b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f47 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.617764:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.617783:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.617820:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.617840:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.617848:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.617855:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.617976:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.617987:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.617993:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946828.618055:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783946828.618124:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946828.618152:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618166:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618175:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618203:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618210:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618217:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946828.618222:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618229:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618246:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946828.618249:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946828.618254:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618260:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db77a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618277:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618282:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618288:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618294:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946828.618303:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618310:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618318:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137983e1500) 00010000:00010000:3.0:1783946828.618321:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946828.618324:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618330:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618372:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db779b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f47 expref: 14 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618386:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f47 expref: 13 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946828.618394:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:3.0:1783946828.618397:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946828.618399:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031800, rc 0) 00000100:00100000:3.0:1783946828.618502:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10395:x1870603507243648:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 920us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946828.618511:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000040:00080000:3.0:1783946829.074331:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783946829.074347:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783946829.074397:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783946829.074406:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783946829.074610:0:12087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523000960:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783946829.074754:0:12087:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7300 going to sleep for 11 seconds 00010000:00010000:2.0:1783946829.080237:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946829.083115:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.083270:0:12087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523000960:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783946829.088582:0:5968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507243776 00000100:00100000:3.0:1783946829.088606:0:5968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507243776 00000100:00100000:3.0:1783946829.088708:0:5968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1783946829.088723:0:5968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10406:x1870603507243776:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783946829.088871:0:5968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10406:x1870603507243776:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 Request processed in 151us (5771us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946829.088881:0:5968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:0.0:1783946829.108874:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946829.109509:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507243904 00000100:00100000:1.0:1783946829.109525:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507243904 00000100:00100000:1.0:1783946829.109619:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1783946829.109633:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10406:x1870603507243904:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783946829.109679:0:5957:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783946829.109843:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10406:x1870603507243904:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 212us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946829.109852:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:0.0:1783946829.119031:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946829.128519:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507244032 00000100:00100000:1.0:1783946829.128539:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507244032 00000100:00100000:1.0:1783946829.133229:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:1.0:1783946829.133253:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10406:x1870603507244032:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783946829.133368:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133391:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133407:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133678:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133707:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133722:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133765:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133776:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133785:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946829.133857:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783946829.133864:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783946829.133881:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133895:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.133902:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134775:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134810:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946829.134816:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134826:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134844:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:1.0:1783946829.134850:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946829.134856:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134862:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db77b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134890:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134897:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134904:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134909:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946829.134912:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.134918:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.135739:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff913796798500) 00010000:00010000:1.0:1783946829.135743:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946829.135747:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.135754:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db77be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.135778:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.135785:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.135793:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.135800:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946829.135804:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.135811:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.135822:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:1.0:1783946829.135824:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946829.135828:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.135834:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db77c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946829.136096:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10406:x1870603507244032:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 2841us (17072us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946829.136109:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:1.0:1783946829.158134:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.166966:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507244288 00000100:00100000:2.0:1783946829.166998:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507244288 00000100:00100000:2.0:1783946829.167149:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:2.0:1783946829.167164:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10406:x1870603507244288:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946829.167199:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946829.167231:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db77cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f4e expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.167445:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.167468:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.167484:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946829.167500:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783946829.170826:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.170856:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.170867:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.170875:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91378151bc00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946829.170882:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.170891:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.170915:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946829.170919:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783946829.170925:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.170932:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.171018:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db77cc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f4e expref: 15 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.171031:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:2.0:1783946829.171033:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946829.171037:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db77cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f4e expref: 15 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.171106:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151ba00, rc 0) 00000100:00100000:2.0:1783946829.171233:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10406:x1870603507244288:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 4070us (13107us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1783946829.171246:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:1.0:1783946829.184599:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.184942:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507244416 00000100:00100000:3.0:1783946829.184960:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507244416 00000100:00100000:3.0:1783946829.185052:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:3.0:1783946829.185103:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10406:x1870603507244416:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783946829.185155:0:5956:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783946829.185329:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10406:x1870603507244416:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 230us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946829.185337:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:0.0:1783946829.194661:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.194751:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507244672 00000100:00100000:2.0:1783946829.194765:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507244672 00000100:00100000:2.0:1783946829.194855:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:2.0:1783946829.194868:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10406:x1870603507244672:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946829.194899:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946829.194904:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783946829.194946:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db778d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f40 expref: 14 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.194972:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:2.0:1783946829.194978:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946829.194997:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db77e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f55 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783946829.195589:0:7190:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1783946829.195775:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.195792:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.195804:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.195886:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ba00/0x229d2ec450db77e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f55 expref: 16 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.195904:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f55 expref: 15 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.195912:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91379793e700) 00010000:00010000:2.0:1783946829.195915:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946829.195918:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151bc00, rc 0) 00000100:00100000:2.0:1783946829.196008:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10406:x1870603507244672:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1142us (1364us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1783946829.196017:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:1.0:1783946829.210687:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.210915:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507244928 00000100:00100000:3.0:1783946829.210933:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507244928 00000100:00100000:3.0:1783946829.211035:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:3.0:1783946829.211047:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10406:x1870603507244928:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783946829.211259:0:5958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946829.211301:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db77e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f55 expref: 15 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211324:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91379793e700) 00010000:00010000:3.0:1783946829.211357:0:5958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946829.211388:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211406:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211418:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211436:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211444:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211451:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211511:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211519:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211527:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211534:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946829.211538:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211559:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211576:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946829.211578:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946829.211583:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211590:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db77f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211602:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211609:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211615:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211621:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946829.211624:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211631:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211639:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb05d9857 (ffff9137983e1500) 00010000:00010000:3.0:1783946829.211641:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946829.211644:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.211650:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db77fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb05d9857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946829.211896:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10406:x1870603507244928:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 849us (1217us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783946829.211905:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:2.0:1783946829.221826:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.221962:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507245056 00000100:00100000:3.0:1783946829.221987:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507245056 00000100:00100000:3.0:1783946829.222094:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:3.0:1783946829.222107:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10406:x1870603507245056:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946829.222138:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946829.222172:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7804 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f5c expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.222219:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.222237:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.222251:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.222401:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f5c expref: 16 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.222424:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f5c expref: 15 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.222435:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:3.0:1783946829.222450:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783946829.222455:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030e00, rc 0) 00000100:00100000:3.0:1783946829.222535:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10406:x1870603507245056:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 432us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946829.222554:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:0.0:1783946829.231038:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.231267:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507245312 00000100:00100000:3.0:1783946829.231322:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507245312 00000100:00100000:3.0:1783946829.231413:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:3.0:1783946829.231429:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10406:x1870603507245312:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783946829.231579:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.231603:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.231620:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783946829.231865:0:5956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1783946829.231876:0:5956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 433150815800ns, next at 434150812801ns, rc = 0 00000004:00010000:3.0:1783946829.231945:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e23c918 reply state 0000000055b8fc5e transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946829.231956:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783946829.232131:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:10406:x1870603507245312:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 705us (1109us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1783946829.232140:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00010000:00010000:1.0:1783946829.236037:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.236098:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.236107:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.236115:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946829.236119:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.236127:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.236147:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:1.0:1783946829.236151:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783946829.236156:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.236162:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7812 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946829.236353:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.236438:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507245440 00000100:00100000:2.0:1783946829.236451:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507245440 00000100:00100000:2.0:1783946829.236530:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:2.0:1783946829.236554:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:10406:x1870603507245440:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946829.236597:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946829.236624:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f63 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.236698:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f63 expref: 17 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.236715:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f63 expref: 17 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.236757:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:2.0:1783946829.236760:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783946829.236763:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151bc00, rc 0) 00000100:00100000:2.0:1783946829.236857:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:10406:x1870603507245440:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 316us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946829.236865:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:0.0:1783946829.242230:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946829.242328:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507245568 00000100:00100000:1.0:1783946829.242343:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507245568 00000100:00100000:1.0:1783946829.242405:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:1.0:1783946829.242418:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1870603507245568:12345-192.168.201.18@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1783946829.242453:0:9002:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:1.0:1783946829.242485:0:9002:0:(genops.c:1406:class_connect()) connect: client c2268401-da9f-4e1e-8a1c-9473caf67cba, cookie 0x229d2ec450db7820 00002000:00100000:1.0:1783946829.242498:0:9002:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c2268401-da9f-4e1e-8a1c-9473caf67cba/ffff9137be508000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783946829.242659:0:9002:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783946829.242752:0:9002:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783946829.242785:0:9002:0:(import.c:65:import_set_state_nolock()) ffff9137be50e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783946829.242867:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2360:x1870603507245568:12345-192.168.201.18@tcp:8:lhsmtool_posix.0 Request processed in 451us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946829.242876:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:1.0:1783946829.250424:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946829.250480:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507245696 00000100:00100000:1.0:1783946829.250490:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507245696 00000100:00100000:1.0:1783946829.250599:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:1.0:1783946829.250611:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:0:x1870603507245696:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783946829.250804:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1783946829.274402:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1783946829.274421:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000100:00100000:3.0:1783946829.274685:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:0:x1870603507245696:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 24066us (24265us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783946829.274718:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:2.0:1783946829.299705:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946829.299830:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507245952 00000100:00100000:1.0:1783946829.299844:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507245952 00000100:00100000:1.0:1783946829.299943:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1783946829.299955:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:10406:x1870603507245952:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783946829.300712:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:10406:x1870603507245952:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 756us (1018us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1783946829.300724:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:0.0:1783946829.308755:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946829.309236:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507246208 00000100:00100000:1.0:1783946829.309248:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507246208 00000100:00100000:1.0:1783946829.309325:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:1.0:1783946829.309337:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:10406:x1870603507246208:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783946829.311203:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:10406:x1870603507246208:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 1853us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946829.311219:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:2.0:1783946829.321239:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.321575:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507246336 00000100:00100000:3.0:1783946829.321589:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507246336 00000100:00100000:3.0:1783946829.321665:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:3.0:1783946829.321678:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:10406:x1870603507246336:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946829.321706:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946829.321736:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7827 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f6a expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.321828:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db782e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.321846:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.321859:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946829.321984:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946829.322012:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.322046:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7827 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f6a expref: 20 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.322104:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db782e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f6a expref: 19 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.322115:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:3.0:1783946829.322254:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783946829.322259:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030800, rc 0) 00000100:00100000:3.0:1783946829.322344:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10406:x1870603507246336:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 668us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946829.322353:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:1.0:1783946829.334274:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.334491:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507246464 00000100:00100000:2.0:1783946829.334507:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507246464 00000100:00100000:2.0:1783946829.334600:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:2.0:1783946829.334614:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507246464:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946829.334640:0:6945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946829.334675:0:6945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f71 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783946829.334710:0:6945:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54de4d, blocks: 0x0 00010000:00010000:2.0:1783946829.334737:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1783946829.334742:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946829.334755:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f71 expref: 6 pid: 6945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.334782:0:6945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f71 expref: 6 pid: 6945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.334824:0:6945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91378151ba00, rc 0) 00000100:00100000:2.0:1783946829.335199:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507246464:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 585us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946829.335210:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1783946829.343270:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.343427:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507246720 00000100:00100000:3.0:1783946829.343442:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507246720 00000100:00100000:3.0:1783946829.343530:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:3.0:1783946829.343554:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10406:x1870603507246720:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783946829.343721:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10406:x1870603507246720:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 181us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946829.343731:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:3.0:1783946829.353941:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946829.356922:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507246848 00000100:00100000:0.0:1783946829.356944:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507246848 00000100:00100000:0.0:1783946829.357050:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:0.0:1783946829.357096:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:10406:x1870603507246848:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783946829.357122:0:6942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946829.357167:0:6942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f78 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.357213:0:6942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f71 expref: 7 pid: 6945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.357222:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946829.357227:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946829.357233:0:6942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 7 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.357283:0:6942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f71 expref: 7 pid: 6945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.357298:0:6942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f71 expref: 7 pid: 6945 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946829.357340:0:6942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6942:1870603523001088:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946829.357484:0:6942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f35e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783946829.366326:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.366707:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507246976 00000100:00100000:2.0:1783946829.366721:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507246976 00010000:00010000:2.0:1783946829.366791:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f71 expref: 8 pid: 6945 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.366849:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:2.0:1783946829.366862:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3533450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507246976:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946829.366884:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783946829.367119:0:6942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6942:1870603523001088:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946829.367235:0:6942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 8 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.367258:0:6942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9c00, rc 0) 00000100:00100000:0.0:1783946829.367350:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:10406:x1870603507246848:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 10288us (13422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946829.367360:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00010000:00010000:2.0:1783946829.368015:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f71 expref: 7 pid: 6945 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.368033:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f71 expref: 7 pid: 6945 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.368088:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091fd51cc/0x229d2ec450db7835 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f71 expref: 7 pid: 6945 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.368106:0:5941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946829.368111:0:5941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946829.368121:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 6 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.368725:0:5941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 6 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.368783:0:5941:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 6 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.368802:0:5941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5941:1870603523001216:192.168.201.18@tcp:105: 00000100:00100000:2.0:1783946829.370116:0:5941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1783946829.383495:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946829.383694:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507247104 00000100:00100000:0.0:1783946829.383710:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507247104 00002000:00100000:0.0:1783946829.383779:0:6950:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9137be6ff100 x1870603507247104/t0(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:375/0 lens 504/0 e 0 to 0 dl 1783946840 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783946829.383792:0:6950:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be6ff100 with x1870603507247104 ext(0->8) 00002000:00010000:0.0:1783946829.383800:0:6950:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be6ff100 00000100:00100000:0.0:1783946829.383839:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1783946829.383852:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507247104:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783946829.387410:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2361:x1870603507247104:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 3545us (3918us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783946829.387430:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00002000:00100000:0.0:1783946829.387446:0:6950:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9137be6ff100 x1870603507247104/t4294967302(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:375/0 lens 504/448 e 0 to 0 dl 1783946840 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783946829.387469:0:6950:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be6ff100 with x1870603507247104 ext(0->8) 00002000:00010000:0.0:1783946829.387477:0:6950:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be6ff100 00000100:00100000:2.0:1783946829.390302:0:5941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5941:1870603523001216:192.168.201.18@tcp:105: 00010000:00010000:2.0:1783946829.390344:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946829.390516:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3533450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507246976:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 23655us (24207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946829.390549:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:1.0:1783946829.415485:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946829.415561:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507247232 00000100:00100000:1.0:1783946829.416679:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507247232 00000100:00100000:1.0:1783946829.416779:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:1.0:1783946829.416793:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10406:x1870603507247232:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783946829.429436:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1783946829.429461:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1783946829.429497:0:5935:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1783946829.430109:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1783946829.430275:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783946829.430493:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10406:x1870603507247232:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 13693us (15012us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946829.430510:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:0.0:1783946829.432441:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523001344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783946829.432529:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946829.433283:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523001344 00000100:00100000:0.0:1783946829.433295:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523001344 00000100:00100000:0.0:1783946829.436535:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783946829.436576:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523001344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783946829.436786:0:9002:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783946829.436790:0:9002:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783946829 00002000:00010000:0.0:1783946829.436793:0:9002:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783946829.436795:0:9002:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783946829 -> 1783946829 00002000:00010000:0.0:1783946829.436798:0:9002:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1783946829.436918:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603523001344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 356us (4386us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1783946829.436926:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1783946829.437098:0:3449:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be6fa300/2, rc 0, transno 4294967303 00000100:00100000:0.0:1783946829.437106:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523001344:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1783946829.444350:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783946829.454869:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.455668:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507247360 00000100:00100000:3.0:1783946829.455684:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507247360 00000100:00100000:3.0:1783946829.455760:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:3.0:1783946829.455772:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2361:x1870603507247360:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1783946829.465423:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1783946829.465445:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1783946829.478500:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507247360:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 22711us (23631us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946829.478518:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:3.0:1783946829.487531:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.490362:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507247616 00000100:00100000:2.0:1783946829.490384:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507247616 00000100:00100000:2.0:1783946829.490471:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:2.0:1783946829.490483:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10406:x1870603507247616:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783946829.490573:0:5956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946829.490606:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db782e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f6a expref: 14 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.490629:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:2.0:1783946829.490635:0:5956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946829.490677:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.490703:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.490715:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946829.490874:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063ba78e1 reply state 00000000078b08fc transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.490885:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783946829.492351:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10406:x1870603507247616:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1858us (4828us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1783946829.492364:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:3.0:1783946829.501453:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:0.0:1783946829.501584:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.501600:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.501610:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.501618:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946829.501624:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.501635:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.501659:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:0.0:1783946829.501663:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946829.501669:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.501677:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7843 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.501760:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507247744 00000100:00100000:2.0:1783946829.501774:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507247744 00000100:00100000:2.0:1783946829.501845:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:2.0:1783946829.501858:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507247744:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783946829.502258:0:9002:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783946829.502262:0:9002:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783946829 -> 1783946828 00002000:00010000:2.0:1783946829.502265:0:9002:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783946826 00002000:00010000:2.0:1783946829.502268:0:9002:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783946829 -> 1783946828 00002000:00010000:2.0:1783946829.502271:0:9002:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783946829.510432:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507247744:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 8553us (8970us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783946829.510455:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:3.0:1783946829.523599:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.524047:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507248000 00000100:00100000:2.0:1783946829.524093:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507248000 00000100:00100000:2.0:1783946829.524325:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:2.0:1783946829.524338:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10406:x1870603507248000:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783946829.524443:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.524464:0:7190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f5c expref: 14 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.524477:0:7190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.524524:0:7190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f5c expref: 14 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.524553:0:7190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f5c expref: 14 pid: 7190 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.524572:0:7190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523001472:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946829.524695:0:7190:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946829.527895:0:7190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523001472:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946829.527953:0:7190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946829.529685:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.531865:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507248128 00000100:00100000:2.0:1783946829.531894:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507248128 00010000:00010000:2.0:1783946829.531973:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f5c expref: 15 pid: 7190 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.532037:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:2.0:1783946829.532090:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:2361:x1870603507248128:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946829.532115:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946829.532123:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f5c expref: 15 pid: 7190 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.532252:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f5c expref: 15 pid: 7190 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.532283:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db780b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f5c expref: 15 pid: 7190 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.532308:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:2.0:1783946829.532314:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.532326:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.532335:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.532369:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946829.532458:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:2361:x1870603507248128:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 398us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946829.532466:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00010000:00010000:3.0:1783946829.533616:0:7190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.533635:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.533709:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.533717:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.533724:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.533732:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946829.533737:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.533745:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.533761:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:3.0:1783946829.533764:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783946829.533769:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.533775:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db784a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946829.533872:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10406:x1870603507248000:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 9532us (10284us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783946829.533884:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:1.0:1783946829.543839:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.544220:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507248256 00000100:00100000:3.0:1783946829.544234:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507248256 00000100:00100000:3.0:1783946829.544309:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:3.0:1783946829.544329:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507248256:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783946829.544392:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.544419:0:6942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 7 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.544431:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946829.544436:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783946829.544443:0:6942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.544499:0:6942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 7 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.544516:0:6942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 7 pid: 6942 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946829.544535:0:6942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6942:1870603523001600:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946829.545348:0:6942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7300 going to sleep for 11 seconds 00000100:00100000:1.0:1783946829.552408:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946829.552461:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507248384 00000100:00100000:1.0:1783946829.552473:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507248384 00010000:00010000:1.0:1783946829.552557:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 8 pid: 6942 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946829.552604:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:1.0:1783946829.552617:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507248384:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946829.552656:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946829.552687:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 8 pid: 6942 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.552704:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 8 pid: 6942 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.552739:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783946829.552744:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783946829.552752:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.552764:0:5943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.552789:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946829.552854:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507248384:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 239us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946829.552863:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00010000:00010000:3.0:1783946829.557266:0:6942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db783c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f78 expref: 7 pid: 6942 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946829.557296:0:6942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6942:1870603523001600:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946829.557328:0:6942:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.557357:0:6942:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.557366:0:6942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.557407:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.557418:0:6942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.557429:0:6942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.557436:0:6942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946829.557441:0:6942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.557451:0:6942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.557479:0:6942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.557498:0:6942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007161d57/0x229d2ec450db7851 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946829.564649:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507248256:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 20304us (20806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946829.564670:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:1.0:1783946829.578577:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946829.579247:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507248640 00000100:00100000:0.0:1783946829.579263:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507248640 00000100:00100000:0.0:1783946829.579365:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:0.0:1783946829.579381:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10406:x1870603507248640:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783946829.579516:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.579555:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f01 expref: 13 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.579566:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.579613:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f01 expref: 13 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.579631:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f01 expref: 13 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946829.579652:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523001728:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946829.579785:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f35e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783946829.586469:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523001728:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946829.587268:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.587427:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507248768 00000100:00100000:2.0:1783946829.587439:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507248768 00010000:00010000:2.0:1783946829.587492:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f01 expref: 14 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.587628:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:2.0:1783946829.587642:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:2361:x1870603507248768:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946829.587665:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946829.587674:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f01 expref: 14 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.587689:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f01 expref: 14 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.587719:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151ae00/0x229d2ec450db7698 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f01 expref: 14 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.587741:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946829.587747:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.587761:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.587770:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.587799:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946829.587881:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:2361:x1870603507248768:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 241us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946829.587889:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00010000:00010000:3.0:1783946829.588012:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.588035:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.588041:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.588805:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.588829:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f63 expref: 14 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.588837:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.591379:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f63 expref: 13 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.591419:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f63 expref: 13 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.591444:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523001856:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946829.592836:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946829.605400:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.605748:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507248896 00000100:00100000:3.0:1783946829.605759:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507248896 00010000:00010000:3.0:1783946829.605803:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f63 expref: 14 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946829.605875:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:3.0:1783946829.605888:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:2361:x1870603507248896:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946829.605906:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946829.605914:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f63 expref: 14 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.605927:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f63 expref: 14 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.605952:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:3.0:1783946829.605958:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.605968:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.605975:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.605998:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946829.606119:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:2361:x1870603507248896:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 232us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946829.606128:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00010000:00010000:1.0:1783946829.606361:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151bc00/0x229d2ec450db7819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f63 expref: 13 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946829.606404:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523001856:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783946829.606437:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.606448:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.606455:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783946829.606634:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1783946829.606784:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1783946829.606823:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1783946829.607113:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523001984:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783946829.609817:0:5958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946829.609885:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0738540 going to sleep for 11 seconds 00000100:00100000:3.0:1783946829.611689:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523001984 00000100:00100000:3.0:1783946829.611709:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523001984 00000100:00100000:3.0:1783946829.611813:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783946829.611827:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5958:x1870603523001984:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783946829.612029:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5958:x1870603523001984:12345-0@lo:1000:mdt00_002.0 Request processed in 205us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946829.612039:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783946829.612096:0:5958:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1783946829.612110:0:5958:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be6fa300, transno 4294967303 00000100:00100000:2.0:1783946829.612993:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523001984:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783946829.613752:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1783946829.613843:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523002112:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783946829.614860:0:5958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946829.615296:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523002112 00000100:00100000:3.0:1783946829.615310:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523002112 00000100:00100000:3.0:1783946829.615380:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783946829.615393:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5958:x1870603523002112:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783946829.616051:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8180 going to sleep for 11 seconds 00000100:00100000:3.0:1783946829.619533:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5958:x1870603523002112:12345-0@lo:1000:mdt00_002.0 Request processed in 4129us (4664us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783946829.619573:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946829.621785:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523002112:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783946829.621881:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.621968:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.621980:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.621989:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946829.621996:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622006:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622043:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1400) 00010000:00010000:2.0:1783946829.622047:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783946829.622055:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622092:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db785f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622674:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622688:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622697:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622705:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946829.622709:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622717:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622729:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:2.0:1783946829.622732:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783946829.622737:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622745:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7794 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622821:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622841:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f47 expref: 16 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.622853:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.624030:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f47 expref: 16 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.624078:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f47 expref: 16 pid: 5956 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.624100:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff913787e1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523002240:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946829.625090:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8180 going to sleep for 11 seconds 00000100:00100000:1.0:1783946829.648516:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff913787e1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523002240:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946829.648544:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:1.0:1783946829.648585:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946829.648967:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507249024 00000100:00100000:0.0:1783946829.648978:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507249024 00010000:00010000:0.0:1783946829.649028:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f47 expref: 17 pid: 5956 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946829.649117:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:0.0:1783946829.649130:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:2361:x1870603507249024:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946829.649146:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946829.649167:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f47 expref: 17 pid: 5956 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649182:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f47 expref: 17 pid: 5956 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649205:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db77b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f47 expref: 17 pid: 5956 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649224:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946829.649229:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649240:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649248:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649278:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946829.649343:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:2361:x1870603507249024:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 215us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946829.649352:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00010000:00010000:0.0:1783946829.649468:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649478:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649492:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649709:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649716:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649722:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946829.649727:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649735:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649746:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946829.649749:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946829.649753:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649760:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7866 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649774:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649781:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649787:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649792:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946829.649805:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649812:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649824:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1900) 00010000:00010000:0.0:1783946829.649826:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783946829.649829:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.649835:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7858 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946829.650102:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10406:x1870603507248640:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 70720us (71540us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1783946829.650112:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 84 00000020:00080000:0.0:1783946829.650118:0:5958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783946829.651375:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783946829.651386:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783946829.651415:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783946829.651423:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783946829.664331:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.664407:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507249280 00000100:00100000:3.0:1783946829.664424:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507249280 00000100:00100000:3.0:1783946829.664526:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1783946829.664554:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10406:x1870603507249280:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783946829.665247:0:5959:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783946829.665285:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1783946829.665318:0:5959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.665336:0:5959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.665348:0:5959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.665377:0:5959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.665385:0:5959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.665391:0:5959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.665417:0:5959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783946829.666057:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:10406:x1870603507249280:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 1515us (1735us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1783946829.666105:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000020:00080000:3.0:1783946829.666112:0:5959:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783946829.666970:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783946829.666987:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.667023:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946829.667029:0:5945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.667043:0:5945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.667094:0:5945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9137983e1500) 00010000:00010000:0.0:1783946829.667106:0:5945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783946829.667114:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.667132:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db786d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.667165:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946829.667168:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946829.667171:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946829.713430:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523002368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946829.713561:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946829.714379:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523002368 00000100:00100000:0.0:1783946829.714403:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523002368 00000100:00100000:0.0:1783946829.714483:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783946829.714497:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137c1160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3450:x1870603523002368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946829.714533:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125952 pending 0 free 3923668992 avail 3692118016 00000100:00100000:0.0:1783946829.714641:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137c1160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3450:x1870603523002368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946829.714650:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783946829.716444:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523002368:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1783946829.741413:0:12396:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783946829.741426:0:12396:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783946829.741452:0:12396:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783946829.741460:0:12396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783946829.919001:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946829.924026:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507249536 00000100:00100000:1.0:1783946829.924045:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507249536 00000100:00100000:1.0:1783946829.924165:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:1.0:1783946829.924178:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:10416:x1870603507249536:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1783946829.924224:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946829.924252:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f7f expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.924426:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db787b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.924446:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db787b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.924460:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db787b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946829.924475:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783946829.924618:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f7f expref: 20 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.924641:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db787b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f7f expref: 19 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946829.924652:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:1.0:1783946829.924655:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783946829.924658:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44600, rc 0) 00000100:00100000:1.0:1783946829.924744:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10416:x1870603507249536:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 568us (5753us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1783946829.924752:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:3.0:1783946829.927220:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946829.927347:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507249664 00000100:00100000:0.0:1783946829.927359:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507249664 00000100:00100000:0.0:1783946829.927435:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:0.0:1783946829.927449:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10416:x1870603507249664:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:0.0:1783946829.927571:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927611:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927627:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927648:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927655:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927663:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927774:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927783:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927791:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783946829.927860:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927877:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927884:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927902:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927910:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946829.927914:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927922:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927937:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:0.0:1783946829.927940:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946829.927946:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927953:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7889 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927972:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927979:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927985:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.927989:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946829.927992:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928008:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928017:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137be239500) 00010000:00010000:0.0:1783946829.928019:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946829.928021:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928027:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928042:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928049:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928054:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928127:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946829.928131:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928138:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928146:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137be239c00) 00010000:00010000:0.0:1783946829.928148:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946829.928151:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946829.928166:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7897 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946829.928412:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10416:x1870603507249664:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 950us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946829.928427:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:0.0:1783946829.989917:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946829.989969:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507249920 00000100:00100000:3.0:1783946829.989986:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507249920 00000100:00100000:3.0:1783946829.990107:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:3.0:1783946829.990122:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10419:x1870603507249920:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946829.990146:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946829.990168:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db789e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f86 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990244:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990273:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990286:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990302:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990309:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990314:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990432:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990441:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990448:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946829.990457:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783946829.990557:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990565:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990572:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990586:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946829.990591:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990599:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990612:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946829.990614:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946829.990619:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990625:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db78a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990639:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990644:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990649:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990654:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946829.990657:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990663:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990680:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137983e1300) 00010000:00010000:3.0:1783946829.990682:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946829.990685:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990691:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990733:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db789e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f86 expref: 22 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990745:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f86 expref: 21 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946829.990752:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:3.0:1783946829.990755:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946829.990757:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030e00, rc 0) 00000100:00100000:3.0:1783946829.990829:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:10419:x1870603507249920:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 712us (925us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1783946829.990837:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:0.0:1783946829.995314:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.995644:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507250048 00000100:00100000:2.0:1783946829.995664:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507250048 00000100:00100000:2.0:1783946829.995744:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:2.0:1783946829.995755:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:10419:x1870603507250048:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1783946829.995830:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.995885:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.995897:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.995947:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.995954:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.995961:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.995967:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946829.995972:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.995980:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.995992:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:2.0:1783946829.995995:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946829.995999:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946829.996005:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db78c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946829.996123:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:10419:x1870603507250048:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 369us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946829.996134:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:0.0:1783946829.998768:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946829.998859:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507250304 00000100:00100000:2.0:1783946829.998873:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507250304 00000100:00100000:2.0:1783946829.998945:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1783946829.998968:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3480450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:10419:x1870603507250304:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946829.999216:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3480450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:10419:x1870603507250304:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 238us (451us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1783946829.999225:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:1.0:1783946830.050235:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946830.059391:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507250560 00000100:00100000:3.0:1783946830.059410:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507250560 00000100:00100000:3.0:1783946830.059523:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:3.0:1783946830.059547:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:9948:x1870603507250560:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1783946830.059723:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946830.059745:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db78c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f8d expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.059909:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.059925:0:7190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f86 expref: 23 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.059934:0:7190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.059970:0:7190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f86 expref: 23 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.059986:0:7190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f86 expref: 23 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946830.060003:0:7190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523002496:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946830.060277:0:7190:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7b40 going to sleep for 11 seconds 00000100:00080000:3.0:1783946830.060307:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946830.073864:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946830.075344:0:7190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523002496:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946830.075376:0:7190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946830.075769:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507250688 00000100:00100000:2.0:1783946830.075778:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507250688 00010000:00010000:2.0:1783946830.075847:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f86 expref: 24 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946830.075887:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:2.0:1783946830.075898:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:2361:x1870603507250688:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946830.075920:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946830.075928:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f86 expref: 24 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.075942:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f86 expref: 24 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.075973:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db78b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f86 expref: 24 pid: 5957 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.075994:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:2.0:1783946830.075999:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.076009:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.076040:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.076116:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946830.076191:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:2361:x1870603507250688:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 294us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946830.076199:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00010000:00010000:3.0:1783946830.077007:0:7190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.077018:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946830.077087:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783946830.079277:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db78c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f8d expref: 24 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.079583:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f8d expref: 23 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.079593:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:3.0:1783946830.079596:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783946830.079599:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030200, rc 0) 00000100:00100000:3.0:1783946830.079664:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:9948:x1870603507250560:12345-192.168.201.18@tcp:101:bash.0 Request processed in 20131us (29503us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1783946830.079673:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:0.0:1783946830.085139:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946830.088038:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507250816 00000100:00100000:0.0:1783946830.088087:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507250816 00000100:00100000:0.0:1783946830.089284:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:0.0:1783946830.089299:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:9948:x1870603507250816:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946830.089515:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946830.089550:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db78dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f94 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.089893:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db78e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.089909:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db78e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.089923:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db78e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.090047:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db78dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f94 expref: 25 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.090108:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db78e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f94 expref: 24 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.090125:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:0.0:1783946830.090129:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783946830.090133:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9400, rc 0) 00000100:00100000:0.0:1783946830.092767:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:9948:x1870603507250816:12345-192.168.201.18@tcp:101:bash.0 Request processed in 3263us (7430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946830.092780:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:3.0:1783946830.099748:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:0.0:1783946830.100586:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946830.103796:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507251072 00000100:00100000:1.0:1783946830.103829:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507251072 00000100:00100000:1.0:1783946830.103904:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:1.0:1783946830.103915:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:9948:x1870603507251072:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:1.0:1783946830.104183:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.104210:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.104222:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783946830.104260:0:5957:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1783946830.104278:0:5957:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f10edf71 reply state 000000000bc9d0c3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946830.104286:0:5957:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783946830.104319:0:5957:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1783946830.104650:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:9948:x1870603507251072:12345-192.168.201.18@tcp:36:bash.0 Request processed in 734us (4911us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1783946830.104658:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 91 00000020:00080000:1.0:1783946830.104663:0:5957:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1783946830.111550:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.111574:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.111583:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.111589:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946830.111609:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.111618:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.111635:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:1.0:1783946830.111639:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946830.111644:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.111653:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db78eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946830.119035:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946830.119924:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507251200 00000100:00100000:2.0:1783946830.119940:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507251200 00000100:00100000:2.0:1783946830.120017:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:2.0:1783946830.120027:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+27:9948:x1870603507251200:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946830.120056:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946830.120106:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db78f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571f9b expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.120172:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db78f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f9b expref: 28 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.120187:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db78f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f9b expref: 28 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.120206:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:2.0:1783946830.120209:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783946830.120214:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9c00, rc 0) 00000100:00100000:2.0:1783946830.120278:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:9948:x1870603507251200:12345-192.168.201.18@tcp:101:bash.0 Request processed in 251us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946830.120285:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:2.0:1783946830.131923:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946830.132301:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507251328 00000100:00100000:0.0:1783946830.132312:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507251328 00000100:00100000:0.0:1783946830.132379:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1783946830.132392:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:9948:x1870603507251328:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946830.132415:0:6945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946830.132443:0:6945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fa2 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783946830.132474:0:6945:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a54de4c, atime: 0x6a54de4a, ctime: 0x6a54de4c, blocks: 0x8 00010000:00010000:0.0:1783946830.132504:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1783946830.132509:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946830.132517:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa2 expref: 7 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.132549:0:6945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa2 expref: 7 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.132564:0:6945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8a00, rc 0) 00000100:00100000:0.0:1783946830.132650:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:9948:x1870603507251328:12345-192.168.201.18@tcp:101:bash.0 Request processed in 260us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946830.132658:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1783946830.136183:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946830.136489:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507251456 00000100:00100000:0.0:1783946830.136500:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507251456 00002000:00010000:0.0:1783946830.136554:0:6948:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1783946830.136559:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff913787e1ea00 with x1870603507251456 ext(0->18446744073709551615) 00002000:00010000:0.0:1783946830.136571:0:6948:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff913787e1ea00. 00000100:00100000:0.0:1783946830.136638:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:0.0:1783946830.136650:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507251456:12345-192.168.201.18@tcp:10:bash.0 00002000:00010000:0.0:1783946830.136954:0:6948:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783946830.136959:0:6948:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783946828 -> 1783946830 00002000:00010000:0.0:1783946830.136962:0:6948:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1783946826 -> 1783946826 00002000:00010000:0.0:1783946830.136965:0:6948:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783946828 -> 1783946830 00002000:00010000:0.0:1783946830.136967:0:6948:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1783946830.137039:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2363:x1870603507251456:12345-192.168.201.18@tcp:10:bash.0 Request processed in 390us (875us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783946830.137047:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00002000:00010000:0.0:1783946830.137051:0:6948:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1783946830.137054:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff913787e1ea00 with x1870603507251456 ext(0->18446744073709551615) 00002000:00010000:0.0:1783946830.137107:0:6948:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff913787e1ea00. 00000100:00100000:3.0:1783946830.254103:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946830.254294:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507251584 00000100:00100000:1.0:1783946830.254305:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507251584 00000100:00100000:1.0:1783946830.254391:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:1.0:1783946830.254404:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:10434:x1870603507251584:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:1.0:1783946830.254499:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.254516:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.254558:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257003:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257018:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257049:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257170:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257180:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257186:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783946830.257248:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257262:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257268:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257275:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257281:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946830.257285:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257292:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257304:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:1.0:1783946830.257313:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946830.257318:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257324:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7900 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257772:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257780:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257787:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257792:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946830.257795:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257801:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257809:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff913797609500) 00010000:00010000:1.0:1783946830.257812:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946830.257815:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257821:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257837:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257849:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257855:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257859:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946830.257862:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257869:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257877:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:1.0:1783946830.257880:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946830.257882:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.257888:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db790e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946830.257991:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:10434:x1870603507251584:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 3585us (3939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946830.258000:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:2.0:1783946830.321257:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946830.321712:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507251840 00000100:00100000:0.0:1783946830.321725:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507251840 00000100:00100000:0.0:1783946830.321829:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:0.0:1783946830.321842:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:10437:x1870603507251840:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946830.321871:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946830.321910:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7915 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fa9 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.321990:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322005:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322017:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322032:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322038:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322044:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322254:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9200/0x229d2ec450db792a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322265:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9200/0x229d2ec450db792a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322273:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9200/0x229d2ec450db792a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946830.322282:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783946830.322761:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322784:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322791:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322797:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946830.322801:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322808:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322821:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:0.0:1783946830.322824:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946830.322828:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322834:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db791c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322848:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322853:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322858:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322863:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946830.322871:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322877:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322885:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137be239500) 00010000:00010000:0.0:1783946830.322887:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946830.322890:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322896:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db7923 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322941:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7915 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa9 expref: 31 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322957:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9200/0x229d2ec450db792a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa9 expref: 30 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.322964:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:0.0:1783946830.322966:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783946830.322969:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9200, rc 0) 00000100:00100000:0.0:1783946830.323165:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+30:10437:x1870603507251840:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1324us (1920us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1783946830.323174:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:2.0:1783946830.332411:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946830.332704:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507251968 00000100:00100000:1.0:1783946830.332715:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507251968 00000100:00100000:1.0:1783946830.332788:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:1.0:1783946830.332800:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+30:10437:x1870603507251968:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:1.0:1783946830.332883:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.332919:0:5957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f8d expref: 30 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.332932:0:5957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.332977:0:5957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f8d expref: 30 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.332992:0:5957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f8d expref: 30 pid: 7190 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946830.333010:0:5957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523002624:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783946830.333901:0:5957:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd776c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946830.338695:0:5957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523002624:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783946830.338726:0:5957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946830.339699:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946830.339915:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507252224 00000100:00100000:3.0:1783946830.339925:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507252224 00000100:00100000:3.0:1783946830.339990:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:3.0:1783946830.340002:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:5910:x1870603507252224:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783946830.340734:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+32:5910:x1870603507252224:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 731us (1036us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1783946830.340744:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:3.0:1783946830.342839:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946830.342924:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507252352 00000100:00100000:0.0:1783946830.342933:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507252352 00010000:00010000:0.0:1783946830.342973:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f8d expref: 32 pid: 7190 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946830.343024:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:0.0:1783946830.343031:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3531850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+32:2361:x1870603507252352:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946830.343045:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946830.343051:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f8d expref: 32 pid: 7190 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.343080:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f8d expref: 32 pid: 7190 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.343100:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db78cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571f8d expref: 32 pid: 7190 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.343115:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:0.0:1783946830.343119:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.343127:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.343133:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.343167:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946830.343213:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3531850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:2361:x1870603507252352:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 181us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946830.343224:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00010000:00010000:3.0:1783946830.343468:0:5957:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.343483:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.343520:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.343537:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.343544:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.343550:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946830.343559:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.343567:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.343576:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:3.0:1783946830.343578:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783946830.343581:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.343588:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7938 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946830.343630:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+30:10437:x1870603507251968:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 10832us (11230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946830.343639:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:3.0:1783946830.346000:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946830.346141:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507252608 00000100:00100000:2.0:1783946830.346150:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507252608 00000100:00100000:2.0:1783946830.346205:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1783946830.346215:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+30:10437:x1870603507252608:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946830.346727:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:10437:x1870603507252608:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 511us (732us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1783946830.346735:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1783946830.472954:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946830.473201:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507252864 00000100:00100000:3.0:1783946830.473215:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507252864 00000100:00100000:3.0:1783946830.473295:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:3.0:1783946830.473308:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:10448:x1870603507252864:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1783946830.473354:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946830.473388:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db793f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fb0 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.473494:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.473511:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.473537:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.473674:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.473684:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.473692:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.473850:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.473920:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.473951:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946830.473967:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1783946830.474135:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474144:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474152:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474160:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946830.474165:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474175:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474192:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946830.474196:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946830.474202:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474209:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7946 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474229:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474237:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474254:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474260:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946830.474263:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474270:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474279:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137983e1300) 00010000:00010000:3.0:1783946830.474281:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946830.474284:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474290:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db794d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474492:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db793f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb0 expref: 34 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474513:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb0 expref: 33 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.474531:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:3.0:1783946830.474533:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946830.474536:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030600, rc 0) 00000100:00100000:3.0:1783946830.474806:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:10448:x1870603507252864:12345-192.168.201.18@tcp:101:cat.0 Request processed in 1498us (1868us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1783946830.474827:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:0.0:1783946830.484379:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946830.484721:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507253120 00000100:00100000:3.0:1783946830.484733:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507253120 00000100:00100000:3.0:1783946830.484801:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:3.0:1783946830.484814:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:10448:x1870603507253120:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:3.0:1783946830.485201:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+34:10448:x1870603507253120:12345-192.168.201.18@tcp:35:cat.0 Request processed in 390us (832us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1783946830.485210:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:0.0:1783946830.511806:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946830.511894:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507253376 00000100:00100000:3.0:1783946830.511905:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507253376 00000100:00100000:3.0:1783946830.511973:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:3.0:1783946830.511984:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+34:10449:x1870603507253376:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:3.0:1783946830.512048:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1783946830.512108:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db78f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f9b expref: 34 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512136:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb0 expref: 33 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512151:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9200/0x229d2ec450db792a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa9 expref: 32 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512177:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db78e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f94 expref: 31 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512188:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1e00) 00010000:00010000:3.0:1783946830.512219:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946830.512244:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512260:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512272:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512289:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512304:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512312:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512397:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512405:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512411:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783946830.512916:0:7190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1783946830.512926:0:7190:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434431865703ns, next at 435431863053ns, rc = 0 00010000:00010000:3.0:1783946830.512976:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.512999:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513007:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513016:0:7190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513022:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513029:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513047:0:7190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946830.513102:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513110:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513116:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513122:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946830.513127:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513135:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513280:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1000) 00010000:00010000:3.0:1783946830.513285:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783946830.513290:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513348:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7970 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513369:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513377:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513382:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513388:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946830.513390:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513396:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513405:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946830.513407:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946830.513410:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.513417:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7962 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.513547:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783946830.513563:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.513570:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946830.513573:0:5945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.513581:0:5945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.513596:0:5945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9137983e1000) 00010000:00010000:0.0:1783946830.513599:0:5945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783946830.513602:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.513608:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7977 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.516332:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946830.516341:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946830.516343:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1783946830.522706:0:7190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec237255 reply state 00000000cac7ea70 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946830.522728:0:7190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783946830.522896:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+32:10449:x1870603507253376:12345-192.168.201.18@tcp:36:rm.0 Request processed in 10909us (11096us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1783946830.522905:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 97 00010000:00010000:3.0:1783946830.530543:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.530563:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.530571:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.530578:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946830.530657:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.530668:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.530688:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137983e1300) 00010000:00010000:3.0:1783946830.530691:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946830.530695:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.530702:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7969 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946830.627786:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946830.630143:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507253632 00000100:00100000:2.0:1783946830.630160:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507253632 00000100:00100000:2.0:1783946830.630320:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:2.0:1783946830.630335:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:10455:x1870603507253632:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946830.630363:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946830.630386:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db797e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fb7 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.630501:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.630517:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.630540:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.630572:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.630580:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.630588:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783946830.630928:0:5958:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1783946830.631099:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631109:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631116:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631148:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631155:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631163:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631169:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946830.631174:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631193:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631205:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:2.0:1783946830.631208:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946830.631212:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631218:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7985 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946830.631231:0:5958:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e386854 reply state 00000000fb06633f transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946830.631239:0:5958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783946830.631265:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db797e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb7 expref: 34 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631280:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb7 expref: 33 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.631288:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91379793ec00) 00010000:00010000:2.0:1783946830.631290:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946830.631293:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8600, rc 0) 00000100:00100000:2.0:1783946830.631373:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+34:10455:x1870603507253632:12345-192.168.201.18@tcp:101:bash.0 Request processed in 1042us (3596us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783946830.631380:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:0.0:1783946830.644417:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946830.644739:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507253760 00000100:00100000:3.0:1783946830.644752:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507253760 00000100:00100000:3.0:1783946830.644837:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1783946830.644850:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507253760:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1783946830.644871:0:6944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946830.645084:0:6944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fbe expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783946830.645112:0:6944:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946830.645136:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1783946830.645141:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946830.645152:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fbe expref: 8 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.645170:0:6944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fbe expref: 8 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.645184:0:6944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030800, rc 0) 00000100:00100000:3.0:1783946830.645244:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2364:x1870603507253760:12345-192.168.201.18@tcp:101:bash.0 Request processed in 397us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946830.645252:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00010000:00010000:1.0:1783946830.645439:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.645450:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.645457:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.645462:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946830.645481:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.645489:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.645504:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91379793ed00) 00010000:00010000:1.0:1783946830.645507:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946830.645511:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.645518:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db798c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783946830.648715:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783946830.652576:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946830.652688:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507253888 00000100:00100000:2.0:1783946830.652719:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507253888 00000100:00100000:2.0:1783946830.652786:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:2.0:1783946830.652797:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:10455:x1870603507253888:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946830.652817:0:9002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946830.652838:0:9002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fc5 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.652885:0:9002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fbe expref: 9 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.652896:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946830.652902:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946830.652908:0:9002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 9 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.652945:0:9002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fbe expref: 9 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.652959:0:9002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fbe expref: 9 pid: 6944 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946830.652976:0:9002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9002:1870603523002752:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946830.653136:0:9002:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1783946830.666931:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946830.667010:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507254016 00000100:00100000:0.0:1783946830.667022:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507254016 00010000:00010000:0.0:1783946830.667115:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fbe expref: 10 pid: 6944 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946830.667179:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:0.0:1783946830.667190:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:2362:x1870603507254016:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946830.667207:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946830.667229:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fbe expref: 10 pid: 6944 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.667243:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fbe expref: 10 pid: 6944 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.667270:0:5941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946830.667275:0:5941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946830.667283:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 10 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946830.667477:0:5941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 10 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946830.667599:0:5941:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 10 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946830.667616:0:5941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5941:1870603523002880:192.168.201.18@tcp:105: 00000100:00100000:1.0:1783946830.667700:0:5941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd776c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783946830.676769:0:9002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027b3fcfd/0x229d2ec450db79a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fbe expref: 10 pid: 6944 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946830.676799:0:9002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9002:1870603523002752:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946830.676861:0:9002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 9 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.676890:0:9002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8000, rc 0) 00000100:00100000:1.0:1783946830.677185:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:10455:x1870603507253888:12345-192.168.201.18@tcp:101:bash.0 Request processed in 24388us (24620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946830.677196:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:1.0:1783946830.677744:0:5941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5941:1870603523002880:192.168.201.18@tcp:105: 00010000:00010000:1.0:1783946830.677760:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946830.677799:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507254016:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 10611us (10879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946830.677808:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:3.0:1783946830.690383:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946830.690573:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507254272 00000100:00100000:1.0:1783946830.690605:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507254272 00000100:00100000:1.0:1783946830.690680:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:1.0:1783946830.690692:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:10455:x1870603507254272:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:1.0:1783946830.691104:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+34:10455:x1870603507254272:12345-192.168.201.18@tcp:35:bash.0 Request processed in 413us (730us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1783946830.691112:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:3.0:1783946830.736574:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523003008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946830.736656:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946830.736775:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523003008 00000100:00100000:1.0:1783946830.736783:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523003008 00000100:00100000:1.0:1783946830.736847:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783946830.736856:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3447:x1870603523003008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946830.736890:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 28672 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946830.736937:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3447:x1870603523003008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946830.736943:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1783946830.738749:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783946830.738818:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523003008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946830.739438:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523003264:0@lo:400:kworker.0 00000100:00100000:1.0:1783946830.739503:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946830.739559:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783946830.739565:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523003392:0@lo:400:kworker.0 00000100:00100000:1.0:1783946830.739590:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946830.739718:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523003520:0@lo:400:kworker.0 00000100:00100000:3.0:1783946830.739752:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946830.739782:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783946830.739789:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523003136:0@lo:400:kworker.0 00000100:00100000:3.0:1783946830.739816:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946830.739840:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523003648:0@lo:400:kworker.0 00000100:00100000:3.0:1783946830.739862:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946830.739890:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523003136 00000100:00100000:3.0:1783946830.739896:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523003136 00000100:00100000:3.0:1783946830.739942:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783946830.739951:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523003136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946830.739994:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523003136:12345-0@lo:400:kworker.0 Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946830.740001:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783946830.740043:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523003136:0@lo:400:kworker.0 00000100:00100000:3.0:1783946830.740089:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523003264 00000100:00100000:3.0:1783946830.740105:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523003264 00000100:00100000:3.0:1783946830.740130:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523003392 00000100:00100000:3.0:1783946830.740132:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523003392 00000100:00100000:3.0:1783946830.740161:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523003648 00000100:00100000:3.0:1783946830.740164:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523003648 00000100:00100000:3.0:1783946830.740179:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783946830.740184:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523003264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946830.740219:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523003264:12345-0@lo:400:kworker.0 Request processed in 34us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946830.740225:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783946830.740242:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783946830.740248:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523003392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946830.740274:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523003392:12345-0@lo:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946830.740280:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783946830.740290:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783946830.740295:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523003648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946830.740322:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523003648:12345-0@lo:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946830.740327:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1783946830.740345:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946830.740365:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523003648:0@lo:400:kworker.0 00000100:00100000:1.0:1783946830.740450:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523003520 00000100:00100000:1.0:1783946830.740459:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523003520 00000100:00100000:1.0:1783946830.740500:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783946830.740507:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3447:x1870603523003520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946830.740555:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3447:x1870603523003520:12345-0@lo:400:kworker.0 Request processed in 49us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946830.740561:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783946830.740597:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523003392:0@lo:400:kworker.0 00000100:00100000:1.0:1783946830.740607:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523003264:0@lo:400:kworker.0 00000100:00100000:3.0:1783946830.741552:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523003520:0@lo:400:kworker.0 00000100:00100000:0.0:1783946830.990504:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946830.990778:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507254400 00000100:00100000:3.0:1783946830.990788:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507254400 00000100:00100000:3.0:1783946830.990857:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:3.0:1783946830.990868:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+34:10471:x1870603507254400:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946830.990912:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946830.990938:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fcc expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.991014:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db79b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.991030:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db79b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.991041:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db79b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946830.991124:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783946830.991129:0:7190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946830.991162:0:7190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db79b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.991188:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fcc expref: 36 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.991207:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db79b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fcc expref: 35 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946830.991215:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946830.991218:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946830.991221:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031800, rc 0) 00000100:00100000:3.0:1783946830.991441:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:10471:x1870603507254400:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 574us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946830.991449:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:0.0:1783946830.998234:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946830.998451:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507254656 00000100:00100000:2.0:1783946830.998464:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507254656 00000100:00100000:2.0:1783946830.998540:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:2.0:1783946830.998568:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:10471:x1870603507254656:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946830.998593:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946830.998617:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db79bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fd3 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.998735:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db79c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.998750:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db79c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.998761:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db79c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946830.998773:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783946830.998886:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db79bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fd3 expref: 38 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.998905:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db79c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fd3 expref: 37 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946830.998914:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91379793ec00) 00010000:00010000:2.0:1783946830.998918:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946830.998921:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8400, rc 0) 00000100:00100000:2.0:1783946830.999000:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:10471:x1870603507254656:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 435us (775us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1783946830.999008:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:2.0:1783946831.008229:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.008294:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946831.008524:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507255040 00000100:00100000:1.0:1783946831.008535:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507255040 00000100:00100000:1.0:1783946831.008619:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1783946831.008632:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:2363:x1870603507255040:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946831.008649:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946831.008675:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db79c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fd3 expref: 37 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.008695:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91379793ec00) 00010000:00010000:1.0:1783946831.008700:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946831.008763:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:2363:x1870603507255040:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 134us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946831.008771:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1783946831.009863:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507254912 00000100:00100000:0.0:1783946831.009873:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507254912 00000100:00100000:0.0:1783946831.009924:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:0.0:1783946831.009933:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:10471:x1870603507254912:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946831.009956:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946831.009988:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9200/0x229d2ec450db79d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fda expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.010164:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db79d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.010178:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db79d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.010189:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db79d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946831.010200:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783946831.010322:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9200/0x229d2ec450db79d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fda expref: 39 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.010339:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db79d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fda expref: 38 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.010347:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91379793ec00) 00010000:00010000:0.0:1783946831.010350:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783946831.010353:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9c00, rc 0) 00000100:00100000:0.0:1783946831.010401:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+38:10471:x1870603507254912:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 470us (2183us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1783946831.010409:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:2.0:1783946831.023656:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946831.023863:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507255168 00000100:00100000:0.0:1783946831.023873:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507255168 00000100:00100000:0.0:1783946831.023940:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1783946831.023951:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507255168:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:0.0:1783946831.024028:0:6945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.024054:0:6945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 8 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.024105:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946831.024109:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946831.024115:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.024158:0:6945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 8 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.024173:0:6945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 8 pid: 9002 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946831.024189:0:6945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6945:1870603523003776:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946831.024313:0:6945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946831.036410:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.036522:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507255296 00000100:00100000:3.0:1783946831.036535:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507255296 00002000:00100000:3.0:1783946831.036609:0:6950:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9137be6fd880 x1870603507255296/t0(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:377/0 lens 504/0 e 0 to 0 dl 1783946842 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783946831.036621:0:6950:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be6fd880 with x1870603507255296 ext(0->8) 00010000:00010000:3.0:1783946831.036631:0:6950:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 9 pid: 9002 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.036650:0:6950:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 9 pid: 9002 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783946831.036660:0:6950:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9137be6fd880 00000100:00100000:3.0:1783946831.036700:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1783946831.036714:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2361:x1870603507255296:12345-192.168.201.18@tcp:4:lfs.0 00000100:00100000:0.0:1783946831.037645:0:6945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6945:1870603523003776:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946831.037676:0:6945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.039406:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:2361:x1870603507255296:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 2687us (3002us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783946831.039418:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00002000:00100000:3.0:1783946831.039430:0:6950:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9137be6fd880 x1870603507255296/t4294967302(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:377/0 lens 504/448 e 0 to 0 dl 1783946842 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783946831.039441:0:6950:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be6fd880 with x1870603507255296 ext(0->8) 00010000:00010000:3.0:1783946831.039450:0:6950:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 11 pid: 9002 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.039468:0:6950:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 11 pid: 9002 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783946831.039493:0:6950:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9137be6fd880 00000100:00100000:3.0:1783946831.049493:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.049949:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507255424 00000100:00100000:2.0:1783946831.049960:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507255424 00010000:00010000:2.0:1783946831.050005:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 11 pid: 9002 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.050052:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:2.0:1783946831.050107:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:2362:x1870603507255424:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946831.050125:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783946831.050144:0:5943:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783946831.050147:0:5943:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783946830 00002000:00010000:2.0:1783946831.050160:0:5943:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783946831 00002000:00010000:2.0:1783946831.050162:0:5943:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783946830 00002000:00010000:2.0:1783946831.050165:0:5943:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783946831.050172:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 11 pid: 9002 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.050187:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 11 pid: 9002 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.050217:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db79a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fc5 expref: 11 pid: 9002 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.050235:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783946831.050239:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783946831.050245:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.050276:0:5943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.050300:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946831.050367:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:2362:x1870603507255424:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 306us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.050374:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00010000:00010000:0.0:1783946831.050582:0:6945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.050603:0:6945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.050626:0:6945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.050634:0:6945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.050643:0:6945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.050650:0:6945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946831.050655:0:6945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.050663:0:6945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.050675:0:6945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.050682:0:6945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008a28ac3/0x229d2ec450db79e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946831.050745:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2362:x1870603507255168:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 26795us (27099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946831.050754:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:2.0:1783946831.056424:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.056768:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507255680 00000100:00100000:3.0:1783946831.056778:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507255680 00000100:00100000:3.0:1783946831.056842:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:3.0:1783946831.056853:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a07e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+38:10471:x1870603507255680:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:3.0:1783946831.056928:0:5959:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db79d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fda expref: 38 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783946831.057230:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1783946831.057265:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1783946831.057831:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1783946831.058257:0:5959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.058276:0:5959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb7 expref: 42 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.058286:0:5959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.058324:0:5959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb7 expref: 42 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.058340:0:5959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb7 expref: 42 pid: 5958 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.058371:0:5959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5959:1870603523003904:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946831.058522:0:5959:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7300 going to sleep for 11 seconds 00000100:00100000:1.0:1783946831.073495:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.074106:0:5959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5959:1870603523003904:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946831.074134:0:5959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946831.080493:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507255808 00000100:00100000:0.0:1783946831.080510:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507255808 00010000:00010000:2.0:1783946831.080747:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb7 expref: 43 pid: 5958 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.080802:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1783946831.080813:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+43:2361:x1870603507255808:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946831.080831:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946831.080840:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb7 expref: 43 pid: 5958 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.080854:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb7 expref: 43 pid: 5958 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.080878:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fb7 expref: 43 pid: 5958 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.080897:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91379793ec00) 00010000:00010000:2.0:1783946831.080903:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.080930:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.080938:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.080978:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946831.081054:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:2361:x1870603507255808:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 243us (7570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.081097:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00010000:00010000:3.0:1783946831.081329:0:5959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.081338:0:5959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783946831.081464:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1783946831.081613:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1783946831.081717:0:5959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5959:1870603523004032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783946831.081778:0:5959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946831.081830:0:5959:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7000 going to sleep for 11 seconds 00000100:00100000:1.0:1783946831.081967:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523004032 00000100:00100000:1.0:1783946831.081973:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523004032 00000100:00100000:1.0:1783946831.082014:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783946831.082023:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5959:x1870603523004032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783946831.082143:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5959:x1870603523004032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 121us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946831.082163:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783946831.083581:0:5959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5959:1870603523004032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783946831.083760:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1783946831.083827:0:5959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be346a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5959:1870603523004160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783946831.083887:0:5959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946831.083925:0:5959:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946831.084047:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523004160 00000100:00100000:1.0:1783946831.084054:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523004160 00000100:00100000:1.0:1783946831.084122:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783946831.084131:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5959:x1870603523004160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783946831.084273:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5959:x1870603523004160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (385us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783946831.084281:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783946831.084863:0:5959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be346a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5959:1870603523004160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783946831.084918:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1783946831.084962:0:5959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.084975:0:5959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.084983:0:5959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.084990:0:5959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.084995:0:5959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.085013:0:5959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.085033:0:5959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91379793ec00) 00010000:00010000:2.0:1783946831.085036:0:5959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783946831.085042:0:5959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.085048:0:5959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db79ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783946831.085917:0:5959:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783946831.085984:0:5959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1783946831.085997:0:5959:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435004936355ns, next at 436004933575ns, rc = 0 00000001:00080000:2.0:1783946831.086007:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1783946831.086037:0:5959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91379793ec00) 00010000:00010000:2.0:1783946831.086040:0:5959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783946831.086048:0:5959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db79d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fda expref: 46 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.086422:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a07e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+45:10471:x1870603507255680:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 29570us (30009us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1783946831.086432:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000020:00080000:2.0:1783946831.086438:0:5959:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783946831.089698:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.089892:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507255936 00000100:00100000:3.0:1783946831.089901:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507255936 00000100:00100000:3.0:1783946831.089963:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:3.0:1783946831.089975:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+45:10471:x1870603507255936:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946831.090001:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.090025:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db79f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fe1 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.090121:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db79f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fe1 expref: 46 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.090156:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db79f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fe1 expref: 46 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.090177:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.090181:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783946831.090184:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030000, rc 0) 00000100:00100000:3.0:1783946831.090235:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+46:10471:x1870603507255936:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 263us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.090242:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:0.0:1783946831.098709:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.101300:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507256192 00000100:00100000:2.0:1783946831.101317:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507256192 00000100:00100000:2.0:1783946831.101404:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:2.0:1783946831.101415:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+46:10471:x1870603507256192:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946831.101693:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:10471:x1870603507256192:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 280us (2996us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1783946831.101702:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00010000:00010000:0.0:1783946831.127133:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946831.253742:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.253936:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507256320 00000100:00100000:3.0:1783946831.253946:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507256320 00000100:00100000:3.0:1783946831.254047:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:3.0:1783946831.254086:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:10481:x1870603507256320:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:3.0:1783946831.254165:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254184:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254197:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254211:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254218:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254244:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254324:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254333:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254340:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783946831.254387:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254401:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254406:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254412:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254417:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946831.254421:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254427:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254438:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946831.254447:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946831.254452:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254458:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db79fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254470:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254475:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254481:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254486:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946831.254488:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254494:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254501:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137983e1b00) 00010000:00010000:3.0:1783946831.254503:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946831.254505:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254546:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254562:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254572:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254578:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254582:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946831.254586:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254591:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254599:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.254601:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946831.254604:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.254609:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.256212:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:10481:x1870603507256320:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 2146us (2467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.256225:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:1.0:1783946831.344023:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.344091:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507256576 00000100:00100000:3.0:1783946831.344100:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507256576 00000100:00100000:3.0:1783946831.344149:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 104 00000100:00100000:3.0:1783946831.344158:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:10484:x1870603507256576:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946831.344180:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.344213:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fe8 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344289:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344305:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344317:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344331:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344338:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344344:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344454:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7a26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344462:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344468:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946831.344479:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783946831.344647:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344668:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344674:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344679:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946831.344682:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344688:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344696:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946831.344698:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946831.344701:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344705:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344714:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344718:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344722:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344724:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946831.344730:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344734:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344738:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137983e1b00) 00010000:00010000:3.0:1783946831.344739:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946831.344741:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344744:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344774:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fe8 expref: 50 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344784:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fe8 expref: 49 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.344788:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.344789:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946831.344790:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030200, rc 0) 00000100:00100000:3.0:1783946831.347646:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:10484:x1870603507256576:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 3471us (3614us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1783946831.347661:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 104 00000100:00100000:1.0:1783946831.353387:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.353473:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507256704 00000100:00100000:2.0:1783946831.353483:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507256704 00000100:00100000:2.0:1783946831.353553:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 105 00000100:00100000:2.0:1783946831.353563:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:10484:x1870603507256704:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1783946831.353643:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.353664:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.353686:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.353723:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.353729:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.353737:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.353742:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.353746:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.353770:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.353782:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.353785:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946831.353789:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.353795:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.353865:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:10484:x1870603507256704:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 304us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.353872:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 105 00000100:00100000:1.0:1783946831.362850:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.362928:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507256960 00000100:00100000:2.0:1783946831.362940:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507256960 00000100:00100000:2.0:1783946831.363003:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:2.0:1783946831.363015:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:10484:x1870603507256960:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946831.363470:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:10484:x1870603507256960:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 455us (626us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1783946831.363478:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:1.0:1783946831.496778:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.496911:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507257216 00000100:00100000:2.0:1783946831.496921:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507257216 00000100:00100000:2.0:1783946831.497050:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:2.0:1783946831.497081:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:10494:x1870603507257216:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946831.497108:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946831.497112:0:5957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783946831.497159:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db79b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fcc expref: 50 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.497181:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:2.0:1783946831.497186:0:5957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946831.497200:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571fef expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.497314:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.497327:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.497338:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946831.497348:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783946831.497446:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fef expref: 52 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.497461:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fef expref: 51 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.497468:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.497470:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946831.497472:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8000, rc 0) 00000100:00100000:2.0:1783946831.497541:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+51:10494:x1870603507257216:12345-192.168.201.18@tcp:101:bash.0 Request processed in 481us (771us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783946831.497549:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:1.0:1783946831.502010:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946831.502095:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.502187:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507257344 00000100:00100000:3.0:1783946831.502196:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507257344 00000100:00100000:3.0:1783946831.502250:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1783946831.502257:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+51:2361:x1870603507257344:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946831.502281:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946831.502302:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fef expref: 51 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.502317:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.502320:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946831.502375:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:2361:x1870603507257344:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 118us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.502384:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1783946831.505159:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507257472 00000100:00100000:2.0:1783946831.505174:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507257472 00000100:00100000:2.0:1783946831.505242:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:2.0:1783946831.505252:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:10494:x1870603507257472:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946831.505287:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946831.505309:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7a50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ff6 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.505356:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.505371:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.505384:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.505498:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7a50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ff6 expref: 52 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.505522:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ff6 expref: 51 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.505532:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.505535:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783946831.505539:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9e00, rc 0) 00000100:00100000:2.0:1783946831.505729:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+51:10494:x1870603507257472:12345-192.168.201.18@tcp:101:bash.0 Request processed in 477us (3734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.505737:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:1.0:1783946831.512376:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.513305:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507257728 00000100:00100000:3.0:1783946831.513316:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507257728 00000100:00100000:3.0:1783946831.513372:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 108 00000100:00100000:3.0:1783946831.513381:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+51:10494:x1870603507257728:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:3.0:1783946831.513429:0:5958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946831.513455:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7a26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fe8 expref: 51 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.513472:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.513476:0:5958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946831.513645:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.513659:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.513669:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783946831.513726:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1783946831.513748:0:5958:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009aff21f7 reply state 0000000097e9655e transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.513756:0:5958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783946831.513840:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+53:10494:x1870603507257728:12345-192.168.201.18@tcp:36:bash.0 Request processed in 460us (1475us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1783946831.513846:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 108 00000020:00080000:3.0:1783946831.513851:0:5958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783946831.517469:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.517483:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.517488:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.517493:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946831.517496:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.517501:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.517526:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.517529:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946831.517534:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.517543:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946831.517898:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.518803:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507257856 00000100:00100000:3.0:1783946831.518815:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507257856 00000100:00100000:3.0:1783946831.518922:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 109 00000100:00100000:3.0:1783946831.518934:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:10494:x1870603507257856:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1783946831.518967:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.519002:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f571ffd expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.519129:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.519153:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.519164:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946831.519195:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783946831.519199:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946831.519220:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.519248:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ffd expref: 54 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.519266:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ffd expref: 53 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.519275:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.519284:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946831.519288:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030800, rc 0) 00000100:00100000:3.0:1783946831.519365:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+53:10494:x1870603507257856:12345-192.168.201.18@tcp:101:bash.0 Request processed in 433us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.519372:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 109 00000100:00100000:1.0:1783946831.525375:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.529457:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507258112 00000100:00100000:2.0:1783946831.529472:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507258112 00000100:00100000:2.0:1783946831.529550:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:2.0:1783946831.529562:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+53:10494:x1870603507258112:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1783946831.529810:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:10494:x1870603507258112:12345-192.168.201.18@tcp:35:bash.0 Request processed in 251us (4444us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1783946831.529820:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1783946831.620342:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.620436:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507258240 00000100:00100000:3.0:1783946831.620447:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507258240 00000100:00100000:3.0:1783946831.620545:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 110 00000100:00100000:3.0:1783946831.620558:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:10500:x1870603507258240:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946831.620585:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.620609:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572004 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.620687:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.620704:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.620716:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946831.620771:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783946831.620776:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946831.620797:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.620823:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572004 expref: 56 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.620872:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572004 expref: 55 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.620883:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:3.0:1783946831.620886:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946831.620889:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031200, rc 0) 00000100:00100000:3.0:1783946831.620952:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:10500:x1870603507258240:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 397us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.621233:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 110 00000100:00100000:1.0:1783946831.625725:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.628694:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507258368 00000100:00100000:2.0:1783946831.628711:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507258368 00000100:00100000:2.0:1783946831.628864:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:2.0:1783946831.628879:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:10500:x1870603507258368:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946831.628903:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946831.628929:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7a81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57200b expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629049:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629081:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629093:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629109:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629116:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629132:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629232:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629241:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629249:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946831.629294:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783946831.629299:0:7190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783946831.629318:0:7190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629331:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629339:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629346:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629353:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629359:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.629364:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629378:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629391:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:2.0:1783946831.629394:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946831.629399:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629405:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7a88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629419:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629438:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629444:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629450:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.629452:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629458:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629465:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137894a1e00) 00010000:00010000:2.0:1783946831.629468:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946831.629470:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629487:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7a8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629530:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7a81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57200b expref: 57 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629552:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57200b expref: 56 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.629559:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.629561:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946831.629564:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8000, rc 0) 00000100:00100000:2.0:1783946831.629637:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:10500:x1870603507258368:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 762us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.629645:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:1.0:1783946831.641126:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.641370:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507258624 00000100:00100000:3.0:1783946831.641380:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507258624 00000100:00100000:3.0:1783946831.641450:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:3.0:1783946831.641461:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:10500:x1870603507258624:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946831.641486:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.641521:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572012 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.641662:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.641679:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ffd expref: 57 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.641687:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57200b expref: 57 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.641716:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.641754:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57200b expref: 57 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.641768:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57200b expref: 57 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.641782:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523004288:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946831.641887:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ffd expref: 57 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.641896:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ffd expref: 57 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.641905:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523004416:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946831.641928:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783946831.654529:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.654848:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507258752 00000100:00100000:2.0:1783946831.654858:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507258752 00010000:00010000:2.0:1783946831.654904:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57200b expref: 58 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.654947:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:2.0:1783946831.654970:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:2361:x1870603507258752:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946831.654988:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946831.654995:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57200b expref: 58 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.655028:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57200b expref: 58 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.655050:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.655055:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.655106:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.655112:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946831.655176:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:2361:x1870603507258752:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 219us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.655184:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00010000:00010000:3.0:1783946831.655367:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57200b expref: 57 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.655386:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523004288:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946831.655397:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523004416:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946831.655421:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946831.660951:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.661149:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507258880 00000100:00100000:3.0:1783946831.661161:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507258880 00010000:00010000:3.0:1783946831.661203:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ffd expref: 57 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.661244:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:3.0:1783946831.661255:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3533850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:2361:x1870603507258880:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946831.661273:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946831.661280:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ffd expref: 57 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.661293:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ffd expref: 57 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.661314:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7a6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ffd expref: 57 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.661330:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.661334:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.661346:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.661354:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.661391:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946831.661460:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3533850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:2361:x1870603507258880:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 207us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.661467:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00010000:00010000:2.0:1783946831.662188:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.662198:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946831.662221:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783946831.662365:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7a9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572012 expref: 57 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.662383:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572012 expref: 56 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.662391:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.662403:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783946831.662405:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030200, rc 0) 00000100:00100000:2.0:1783946831.662455:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:10500:x1870603507258624:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 20995us (21340us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1783946831.662463:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:1.0:1783946831.673232:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.673561:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507259136 00000100:00100000:2.0:1783946831.673572:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507259136 00000100:00100000:2.0:1783946831.673645:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1783946831.673655:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:10500:x1870603507259136:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:2.0:1783946831.673672:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946831.673703:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db79f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fe1 expref: 56 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.673725:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.673730:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946831.673800:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:10500:x1870603507259136:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 146us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.673807:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1783946831.681411:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.681515:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507259264 00000100:00100000:3.0:1783946831.681527:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507259264 00000100:00100000:3.0:1783946831.681614:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:3.0:1783946831.681626:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:10500:x1870603507259264:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:3.0:1783946831.681780:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.681801:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.681813:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783946831.682148:0:5956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1783946831.682247:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:10500:x1870603507259264:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 622us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.682255:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:0.0:1783946831.693860:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.694246:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507259392 00000100:00100000:2.0:1783946831.694255:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507259392 00000100:00100000:2.0:1783946831.694324:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:2.0:1783946831.694337:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:10500:x1870603507259392:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946831.694360:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946831.694382:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572019 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.694440:0:5957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.694470:0:5957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572019 expref: 56 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.694491:0:5957:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.694516:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572019 expref: 56 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.694532:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.694535:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783946831.694539:0:5957:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572019 expref: 56 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.694546:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8a00, rc 0) 00000100:00100000:2.0:1783946831.694651:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:10500:x1870603507259392:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 316us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.694659:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 114 00000040:00080000:2.0:1783946831.696326:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783946831.696335:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783946831.696371:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1783946831.696380:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783946831.696522:0:12087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be345c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523004544:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783946831.696618:0:12087:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783946831.706601:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.706685:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507259520 00000100:00100000:3.0:1783946831.706696:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507259520 00000100:00100000:3.0:1783946831.706769:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:3.0:1783946831.706779:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:10501:x1870603507259520:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783946831.706816:0:5956:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783946831.706945:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:10501:x1870603507259520:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 167us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.706963:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:2.0:1783946831.707731:0:12087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be345c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523004544:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783946831.712281:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.712370:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507259648 00000100:00100000:2.0:1783946831.712391:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507259648 00000100:00100000:2.0:1783946831.712444:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:2.0:1783946831.712452:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:10501:x1870603507259648:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783946831.712524:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712540:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712552:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712614:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712621:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712625:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712645:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712651:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712655:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946831.712693:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783946831.712697:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783946831.712711:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712720:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712724:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712729:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712732:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.712735:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712740:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712749:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:2.0:1783946831.712751:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946831.712753:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712757:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7ac0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712765:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712769:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712773:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712779:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.712781:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712785:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712789:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9137894a1e00) 00010000:00010000:2.0:1783946831.712790:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946831.712792:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712795:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7ac7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712804:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712808:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712811:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712814:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.712815:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712818:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712828:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.712830:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946831.712831:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.712834:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7ace lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.712906:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:10501:x1870603507259648:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 453us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.712914:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:1.0:1783946831.716442:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.716546:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507259904 00000100:00100000:3.0:1783946831.716556:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507259904 00000100:00100000:3.0:1783946831.716617:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:3.0:1783946831.716627:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:10501:x1870603507259904:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946831.716651:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.716675:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7ad5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572020 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.716786:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.716803:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.716816:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946831.716829:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783946831.716917:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.716925:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.716932:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.716938:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946831.716942:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.716949:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.716978:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.716982:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783946831.716986:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.716993:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7adc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.717041:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7ad5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572020 expref: 58 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.717052:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:3.0:1783946831.717054:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783946831.717076:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7ad5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572020 expref: 58 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.717086:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030e00, rc 0) 00000100:00100000:3.0:1783946831.717148:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:10501:x1870603507259904:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 522us (716us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1783946831.717155:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:0.0:1783946831.721426:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.721533:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507260032 00000100:00100000:2.0:1783946831.721547:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507260032 00000100:00100000:2.0:1783946831.721617:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:2.0:1783946831.721628:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:10501:x1870603507260032:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783946831.721664:0:5957:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783946831.721771:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:10501:x1870603507260032:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 145us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.721779:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:1.0:1783946831.727989:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946831.728664:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507260288 00000100:00100000:0.0:1783946831.728675:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507260288 00000100:00100000:0.0:1783946831.728774:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:0.0:1783946831.728785:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:10501:x1870603507260288:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783946831.728807:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946831.728809:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783946831.728837:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7a7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572004 expref: 57 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.728868:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:0.0:1783946831.728873:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783946831.728889:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db7aea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572027 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783946831.729749:0:7190:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1783946831.729898:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.729914:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.729925:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.729979:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db7aea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572027 expref: 59 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.729997:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572027 expref: 58 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.730006:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137be239500) 00010000:00010000:0.0:1783946831.730008:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946831.730012:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8c00, rc 0) 00000100:00100000:0.0:1783946831.730725:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:10501:x1870603507260288:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1937us (2743us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1783946831.730734:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:1.0:1783946831.735941:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.736107:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507260544 00000100:00100000:2.0:1783946831.736118:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507260544 00000100:00100000:2.0:1783946831.739011:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:2.0:1783946831.739032:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:10501:x1870603507260544:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783946831.739115:0:5957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946831.739625:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572027 expref: 58 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739672:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137be239500) 00010000:00010000:2.0:1783946831.739684:0:5957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946831.739711:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739726:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739736:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739801:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739808:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739816:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739866:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739874:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739880:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739886:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.739891:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739908:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739917:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:2.0:1783946831.739919:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946831.739923:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739929:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7aff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739939:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739945:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739950:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739955:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.739958:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739965:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739972:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc094ba8f (ffff9137894a1e00) 00010000:00010000:2.0:1783946831.739974:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946831.739977:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.739991:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc094ba8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.741037:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:10501:x1870603507260544:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 2005us (5097us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783946831.741048:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:1.0:1783946831.747468:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.747754:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507260672 00000100:00100000:3.0:1783946831.747764:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507260672 00000100:00100000:3.0:1783946831.747856:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:3.0:1783946831.747868:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:10501:x1870603507260672:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946831.747891:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.747914:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7b0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57202e expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.747979:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.747993:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.748005:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.748311:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7b0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57202e expref: 59 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.748332:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57202e expref: 58 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.748341:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:3.0:1783946831.748345:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783946831.748349:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030000, rc 0) 00000100:00100000:3.0:1783946831.748527:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:10501:x1870603507260672:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 660us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.748541:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:1.0:1783946831.751396:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.751477:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507260928 00000100:00100000:3.0:1783946831.751487:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507260928 00000100:00100000:3.0:1783946831.751587:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:3.0:1783946831.751600:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:10501:x1870603507260928:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783946831.751693:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.751731:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.751743:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783946831.751894:0:5958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1783946831.751903:0:5958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 435670842812ns, next at 436670840305ns, rc = 0 00000004:00010000:3.0:1783946831.751948:0:5958:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066a2cca0 reply state 0000000006e2fbbb transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.751957:0:5958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783946831.752108:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:10501:x1870603507260928:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 511us (722us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1783946831.752115:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:1.0:1783946831.756014:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.756097:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507261056 00010000:00010000:0.0:1783946831.756105:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.756107:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507261056 00010000:00010000:0.0:1783946831.756116:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.756149:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.756156:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946831.756160:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.756168:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.756185:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:0.0:1783946831.756188:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783946831.756193:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.756200:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.756274:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:2.0:1783946831.756285:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:10501:x1870603507261056:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946831.756310:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946831.756329:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572035 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.756380:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572035 expref: 60 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.756393:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572035 expref: 60 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.756409:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:2.0:1783946831.756412:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783946831.756414:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8600, rc 0) 00000100:00100000:2.0:1783946831.756474:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:10501:x1870603507261056:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 190us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.756481:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:1.0:1783946831.760941:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.761050:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507261184 00000100:00100000:2.0:1783946831.761192:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507261184 00000100:00100000:2.0:1783946831.761295:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:2.0:1783946831.761304:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a5f19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507261184:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783946831.761495:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a5f19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2362:x1870603507261184:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 191us (561us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783946831.761514:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00080000:3.0:1783946831.761677:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946831.764943:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.765027:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507261440 00000100:00100000:3.0:1783946831.765037:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507261440 00000100:00100000:3.0:1783946831.765117:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:3.0:1783946831.765127:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:10501:x1870603507261440:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783946831.765368:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:10501:x1870603507261440:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 241us (434us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1783946831.765375:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:0.0:1783946831.770869:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.770961:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507261696 00000100:00100000:2.0:1783946831.770972:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507261696 00000100:00100000:2.0:1783946831.771103:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:2.0:1783946831.771115:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:10501:x1870603507261696:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783946831.771236:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:10501:x1870603507261696:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 123us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.771244:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:1.0:1783946831.773780:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.773864:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507261824 00000100:00100000:3.0:1783946831.773873:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507261824 00000100:00100000:3.0:1783946831.773932:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:3.0:1783946831.773941:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:10501:x1870603507261824:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946831.773970:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.774003:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57203c expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.774110:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.774124:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.774250:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946831.774359:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946831.774382:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.774409:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57203c expref: 63 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.774427:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57203c expref: 62 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.774435:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:0.0:1783946831.774444:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783946831.774447:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031800, rc 0) 00000100:00100000:0.0:1783946831.774515:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:10501:x1870603507261824:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 574us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946831.774523:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:1.0:1783946831.778256:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.778433:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507261952 00000100:00100000:2.0:1783946831.778443:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507261952 00000100:00100000:2.0:1783946831.778548:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:2.0:1783946831.778559:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2361:x1870603507261952:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946831.778579:0:9002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946831.778599:0:9002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572043 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783946831.778625:0:9002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54de4f, blocks: 0x0 00010000:00010000:2.0:1783946831.778645:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1783946831.778650:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946831.778660:0:9002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572043 expref: 10 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.778692:0:9002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572043 expref: 10 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.778704:0:9002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8200, rc 0) 00000100:00100000:2.0:1783946831.778766:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:2361:x1870603507261952:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 210us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.778773:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:1.0:1783946831.782491:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.782618:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507262208 00000100:00100000:3.0:1783946831.782628:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507262208 00000100:00100000:3.0:1783946831.782691:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:3.0:1783946831.782702:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:10501:x1870603507262208:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783946831.782839:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:10501:x1870603507262208:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 138us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.782846:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:1.0:1783946831.786049:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.786258:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507262336 00000100:00100000:3.0:1783946831.786267:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507262336 00000100:00100000:3.0:1783946831.786322:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:3.0:1783946831.786332:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:10501:x1870603507262336:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946831.786351:0:6944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.786375:0:6944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57204a expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.786433:0:6944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572043 expref: 11 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.786442:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946831.786446:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946831.786451:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 11 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.786488:0:6944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572043 expref: 11 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.786510:0:6944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572043 expref: 11 pid: 9002 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.786524:0:6944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6944:1870603523004672:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946831.786637:0:6944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fb7540 going to sleep for 11 seconds 00000100:00100000:1.0:1783946831.790042:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.790181:0:6944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6944:1870603523004672:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946831.790214:0:6944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 11 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.790234:0:6944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030e00, rc 0) 00000100:00100000:3.0:1783946831.790288:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:10501:x1870603507262336:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 3958us (4248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.790296:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:2.0:1783946831.790469:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507262464 00000100:00100000:2.0:1783946831.790477:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507262464 00010000:00010000:2.0:1783946831.790518:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572043 expref: 11 pid: 9002 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.790563:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:2.0:1783946831.790572:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:2361:x1870603507262464:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946831.790586:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946831.790612:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572043 expref: 11 pid: 9002 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.790624:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572043 expref: 11 pid: 9002 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.790651:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572043 expref: 11 pid: 9002 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.790680:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946831.790686:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946831.790695:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 10 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.790705:0:5943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 10 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.790740:0:5943:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 10 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.790753:0:5943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be344a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5943:1870603523004800:192.168.201.18@tcp:105: 00000100:00100000:2.0:1783946831.790812:0:5943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783946831.802451:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946831.802562:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507262592 00000100:00100000:1.0:1783946831.802573:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507262592 00002000:00100000:1.0:1783946831.802628:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9137b65aa680 x1870603507262592/t0(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:377/0 lens 504/0 e 0 to 0 dl 1783946842 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783946831.802639:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137b65aa680 with x1870603507262592 ext(0->12) 00002000:00010000:1.0:1783946831.802645:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137b65aa680 00000100:00100000:1.0:1783946831.802679:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:1.0:1783946831.802687:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:2362:x1870603507262592:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783946831.803354:0:5943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be344a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5943:1870603523004800:192.168.201.18@tcp:105: 00010000:00010000:2.0:1783946831.803377:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946831.803439:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:2361:x1870603507262464:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 12867us (13404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.803449:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:0.0:1783946831.804402:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:2362:x1870603507262592:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 1707us (1953us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783946831.804413:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00002000:00100000:0.0:1783946831.804424:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9137b65aa680 x1870603507262592/t4294967308(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:377/0 lens 504/448 e 0 to 0 dl 1783946842 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783946831.804434:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137b65aa680 with x1870603507262592 ext(0->12) 00002000:00010000:0.0:1783946831.804439:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137b65aa680 00000100:00100000:0.0:1783946831.808799:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.808911:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507262720 00000100:00100000:2.0:1783946831.808921:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507262720 00000100:00100000:2.0:1783946831.808984:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:2.0:1783946831.809005:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:10501:x1870603507262720:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783946831.811514:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1783946831.811577:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1783946831.811661:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783946831.811694:0:5935:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9137a36d8b40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783946831.811700:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137be499600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9137a36d8840 00000020:00080000:1.0:1783946831.811703:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137be499300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9137be58ec00 00000004:00080000:1.0:1783946831.811735:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1783946831.811780:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783946831.812124:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783946831.812154:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523004928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783946831.812235:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946831.812290:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523004928 00000100:00100000:0.0:1783946831.812296:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523004928 00000100:00100000:0.0:1783946831.812346:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783946831.812354:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3450:x1870603523004928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783946831.812382:0:6945:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1783946831.812414:0:6945:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a54de4e, atime: 0x6a54de4f, ctime: 0x6a54de4e, blocks: 0x8 00010000:00010000:0.0:1783946831.812423:0:6945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812455:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1783946831.812460:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946831.812467:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812484:0:6945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812494:0:6945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812513:0:6945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812541:0:6945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783946831.812714:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3450:x1870603523004928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 359us (479us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783946831.812723:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1783946831.812772:0:3450:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137bde8f100/2, rc 0, transno 4294967304 00000100:00100000:0.0:1783946831.812778:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523004928:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783946831.812792:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783946831.812799:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812807:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946831.812820:0:5945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812831:0:5945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812853:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812861:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7b45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.812883:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946831.812885:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946831.812886:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946831.814105:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783946831.814126:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523005184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783946831.814247:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946831.814267:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523005056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783946831.814323:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946831.814374:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523005056 00000100:00100000:2.0:1783946831.814381:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523005056 00000100:00100000:2.0:1783946831.814436:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783946831.814445:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603523005056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783946831.814469:0:6942:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1783946831.814495:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.814527:0:6942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa2 expref: 11 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.814544:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783946831.814548:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783946831.814553:0:6942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.814581:0:6942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa2 expref: 11 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.814594:0:6942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa2 expref: 11 pid: 6945 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.814606:0:6942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be345c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6942:1870603523005312:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946831.814663:0:6942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8300 going to sleep for 11 seconds 00000100:00100000:3.0:1783946831.817809:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783946831.817876:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946831.817894:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523005184 00000100:00100000:3.0:1783946831.817904:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523005184 00000100:00100000:3.0:1783946831.817963:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783946831.817974:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3448:x1870603523005184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783946831.818173:0:6944:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783946831.818176:0:6944:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783946831 00002000:00010000:3.0:1783946831.818179:0:6944:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783946831.818181:0:6944:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783946831 -> 1783946831 00002000:00010000:3.0:1783946831.818183:0:6944:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783946831.818224:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3448:x1870603523005184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 252us (422us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1783946831.818231:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1783946831.818273:0:3448:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be7bdf80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1783946831.818280:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523005184:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1783946831.818757:0:5935:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9137a36d8000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783946831.818762:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137be499700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9137a36d86c0 00000020:00080000:1.0:1783946831.818766:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137be499000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9137be1ed200 00000020:00080000:2.0:1783946831.818831:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1783946831.818895:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1783946831.819432:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:10501:x1870603507262720:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 10435us (10641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.819442:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:0.0:1783946831.819720:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.820190:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507262848 00000100:00100000:3.0:1783946831.820201:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507262848 00010000:00010000:3.0:1783946831.820249:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa2 expref: 12 pid: 6945 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.820294:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:3.0:1783946831.820305:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:2361:x1870603507262848:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946831.820325:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946831.820331:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa2 expref: 12 pid: 6945 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.820357:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa2 expref: 12 pid: 6945 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.820385:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783946831.820390:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783946831.820396:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.820407:0:8023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.820428:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946831.820472:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:2361:x1870603507262848:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 169us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.820479:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00010000:00010000:2.0:1783946831.820659:0:6942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b37780db/0x229d2ec450db78f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f571fa2 expref: 11 pid: 6945 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.820676:0:6942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be345c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6942:1870603523005312:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946831.820696:0:6942:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.820706:0:6942:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.820714:0:6942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.820724:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.820731:0:6942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.820754:0:6942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783946831.820942:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3449:x1870603523005056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6498us (6618us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783946831.820962:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1783946831.820999:0:3449:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be7bed80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1783946831.821005:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523005056:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783946831.824100:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946831.824113:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.824127:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946831.824132:0:5944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.824152:0:5944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.824193:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.824201:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003220f5cf/0x229d2ec450db7b4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.824222:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946831.824224:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946831.824226:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946831.824644:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.824939:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507262976 00000100:00100000:3.0:1783946831.824949:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507262976 00000100:00100000:3.0:1783946831.825016:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:3.0:1783946831.825026:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:2362:x1870603507262976:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1783946831.826811:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1783946831.826824:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1783946831.827269:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507262976:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 2238us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.827280:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:2.0:1783946831.830714:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.830785:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507263232 00000100:00100000:3.0:1783946831.830799:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507263232 00000100:00100000:3.0:1783946831.830864:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 128 00000100:00100000:3.0:1783946831.830874:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:10501:x1870603507263232:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783946831.830924:0:5958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946831.830950:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57203c expref: 16 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.830972:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:3.0:1783946831.830989:0:5958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946831.831026:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.831039:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.831049:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783946831.831229:0:5958:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebad2be1 reply state 000000004ab091bf transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.831238:0:5958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783946831.831344:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:10501:x1870603507263232:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 471us (639us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1783946831.831351:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 128 00010000:00010000:3.0:1783946831.839145:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.839167:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.839175:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.839182:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946831.839188:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.839198:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.839246:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:3.0:1783946831.839249:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946831.839254:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.839261:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.843730:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946831.844097:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507263360 00000100:00100000:1.0:1783946831.844108:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507263360 00000100:00100000:1.0:1783946831.844176:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:1.0:1783946831.844185:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507263360:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783946831.844349:0:9002:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783946831.844353:0:9002:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1783946831 -> 1783946831 00002000:00010000:1.0:1783946831.844356:0:9002:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783946831 00002000:00010000:1.0:1783946831.844358:0:9002:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783946831 -> 1783946831 00002000:00010000:1.0:1783946831.844360:0:9002:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783946831.844435:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507263360:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 250us (715us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783946831.844443:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:0.0:1783946831.849354:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.849470:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507263616 00000100:00100000:2.0:1783946831.849481:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507263616 00000100:00100000:2.0:1783946831.849569:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 129 00000100:00100000:2.0:1783946831.849581:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:10501:x1870603507263616:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783946831.849663:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.849680:0:7190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57202e expref: 16 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.849691:0:7190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.849729:0:7190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57202e expref: 16 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.849744:0:7190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57202e expref: 16 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.849760:0:7190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523005440:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946831.849871:0:7190:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8240 going to sleep for 11 seconds 00000100:00100000:2.0:1783946831.855329:0:7190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523005440:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946831.855382:0:7190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946831.859274:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.859570:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507263744 00000100:00100000:3.0:1783946831.859581:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507263744 00010000:00010000:3.0:1783946831.859626:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57202e expref: 17 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.859673:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:3.0:1783946831.859682:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:2362:x1870603507263744:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946831.859698:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946831.859705:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57202e expref: 17 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.859719:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57202e expref: 17 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.859740:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57202e expref: 17 pid: 5956 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.859757:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:3.0:1783946831.859762:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.859784:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.859792:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.859822:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946831.860231:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:2362:x1870603507263744:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 548us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.860239:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00010000:00010000:0.0:1783946831.860634:0:7190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.860644:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.860690:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.860697:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.860714:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.860720:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946831.860724:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.860732:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.860743:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:0.0:1783946831.860746:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783946831.860749:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946831.860755:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7b5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946831.860810:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10501:x1870603507263616:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 11232us (11468us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783946831.860819:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 129 00000100:00100000:0.0:1783946831.864757:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.864879:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507263872 00000100:00100000:2.0:1783946831.864890:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507263872 00000100:00100000:2.0:1783946831.864958:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:2.0:1783946831.864968:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507263872:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783946831.865032:0:6945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.865054:0:6945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 7 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.865096:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946831.865100:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783946831.865105:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.865155:0:6945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 7 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.865170:0:6945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 7 pid: 6944 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.865186:0:6945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6945:1870603523005568:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946831.865272:0:6945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8240 going to sleep for 11 seconds 00000100:00100000:2.0:1783946831.874163:0:6945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6945:1870603523005568:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946831.874197:0:6945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946831.879747:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.880254:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507264000 00000100:00100000:3.0:1783946831.880267:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507264000 00010000:00010000:3.0:1783946831.880314:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 8 pid: 6944 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.880359:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:3.0:1783946831.880368:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507264000:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946831.880382:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946831.880403:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 8 pid: 6944 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.880416:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 8 pid: 6944 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.880437:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7b3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57204a expref: 8 pid: 6944 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.880473:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783946831.880477:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783946831.880483:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.880492:0:8023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.880625:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946831.880691:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507264000:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 323us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.880699:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00010000:00010000:2.0:1783946831.882573:0:6945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.882592:0:6945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.882624:0:6945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.882633:0:6945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.882643:0:6945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.882649:0:6945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946831.882654:0:6945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.882662:0:6945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.882700:0:6945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.882709:0:6945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3ca9421/0x229d2ec450db7b61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.882856:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507263872:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 17885us (18106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946831.882868:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:0.0:1783946831.884962:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.885366:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507264256 00000100:00100000:3.0:1783946831.885377:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507264256 00000100:00100000:2.0:1783946831.885593:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 130 00000100:00100000:2.0:1783946831.885604:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:10501:x1870603507264256:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783946831.885689:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.885705:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ff6 expref: 15 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.885714:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.885745:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ff6 expref: 15 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.885758:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ff6 expref: 15 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.885792:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523005696:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946831.885915:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1783946831.894626:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.895179:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507264384 00000100:00100000:3.0:1783946831.895190:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507264384 00010000:00010000:3.0:1783946831.895232:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ff6 expref: 16 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.895278:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:3.0:1783946831.895288:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:2362:x1870603507264384:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946831.895304:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946831.895310:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ff6 expref: 16 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.895324:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ff6 expref: 16 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.895370:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946831.895376:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572019 expref: 16 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.895387:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.895396:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.895404:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.895425:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946831.895723:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:2362:x1870603507264384:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 435us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.895731:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00010000:00010000:2.0:1783946831.896895:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7a57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f571ff6 expref: 15 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.896921:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523005696:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946831.896945:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.896956:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.896963:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.897206:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.897219:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572035 expref: 15 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.897228:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.897263:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572035 expref: 15 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.897279:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572035 expref: 15 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.897309:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523005824:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946831.897383:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8300 going to sleep for 11 seconds 00000100:00100000:1.0:1783946831.903947:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.904013:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507264512 00000100:00100000:3.0:1783946831.904025:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507264512 00000100:00100000:2.0:1783946831.904044:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523005824:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946831.904091:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572035 expref: 16 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.904097:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.904151:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:3.0:1783946831.904161:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3530050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:2361:x1870603507264512:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946831.904180:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946831.904188:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572035 expref: 16 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.904225:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572035 expref: 16 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.904250:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7b22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572035 expref: 16 pid: 7190 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.904266:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:3.0:1783946831.904271:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.904281:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.904289:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.904317:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946831.904335:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.904341:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.904370:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3530050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:2361:x1870603507264512:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 210us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.904377:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000001:00080000:2.0:1783946831.904454:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1783946831.904591:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1783946831.904630:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1783946831.904712:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523005952:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783946831.904756:0:5958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946831.904796:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946831.905228:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523005952 00000100:00100000:3.0:1783946831.905236:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523005952 00000100:00100000:3.0:1783946831.905331:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783946831.905341:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5958:x1870603523005952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783946831.905438:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5958:x1870603523005952:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.905445:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783946831.906345:0:5958:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1783946831.906355:0:5958:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1783946831.906377:0:5958:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be7bdf80, transno 4294967309 00000004:00080000:1.0:1783946831.906399:0:5958:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be7bed80, transno 4294967310 00000100:00100000:1.0:1783946831.906408:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523005952:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1783946831.906775:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1783946831.906842:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523006080:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783946831.906985:0:5958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946831.907085:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd773c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946831.911319:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523006080 00000100:00100000:3.0:1783946831.911334:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523006080 00000100:00100000:0.0:1783946831.913817:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783946831.913843:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5958:x1870603523006080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783946831.914267:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5958:x1870603523006080:12345-0@lo:1000:mdt00_002.0 Request processed in 437us (7281us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783946831.914297:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783946831.914423:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523006080:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1783946831.914476:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914509:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914518:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914525:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946831.914612:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914624:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914642:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137983e1b00) 00010000:00010000:1.0:1783946831.914645:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783946831.914650:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914657:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7b6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914694:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914701:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914706:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914712:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946831.914721:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914727:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914737:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:1.0:1783946831.914740:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783946831.914747:0:5958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572019 expref: 18 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914759:0:5958:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572019 expref: 18 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914768:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572019 expref: 18 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.914803:0:5958:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572019 expref: 18 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946831.914816:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523006208:192.168.201.18@tcp:105: 00000100:00100000:1.0:1783946831.914906:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdd773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946831.919595:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.920056:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507264640 00000100:00100000:3.0:1783946831.920119:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507264640 00000100:00100000:2.0:1783946831.920337:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523006208:192.168.201.18@tcp:105: 00010000:00010000:2.0:1783946831.920370:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920381:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ab2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920416:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.920447:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00010000:00010000:2.0:1783946831.920447:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.920457:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10500:x1870603507264640:12345-192.168.201.18@tcp:49:lfs.0 00010000:00010000:2.0:1783946831.920459:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920469:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920474:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920480:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920485:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.920488:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920494:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920515:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.920518:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946831.920522:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920527:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7b76 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920538:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920552:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920557:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920562:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946831.920564:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920569:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920577:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946831.920579:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783946831.920581:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.920586:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946831.920607:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:10500:x1870603507264640:12345-192.168.201.18@tcp:49:lfs.0 Request processed in 150us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946831.920614:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000040:00080000:2.0:1783946831.920763:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783946831.920768:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783946831.921342:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783946831.921351:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783946831.921434:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:10501:x1870603507264256:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 35829us (36478us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1783946831.921443:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 130 00000020:00080000:2.0:1783946831.921447:0:5958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783946831.927931:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946831.928029:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946831.928160:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507265152 00000100:00100000:2.0:1783946831.928184:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507265152 00000100:00100000:2.0:1783946831.928246:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:2.0:1783946831.928258:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a07e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:10501:x1870603507265152:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783946831.928725:0:5960:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783946831.928768:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1783946831.928808:0:5960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.928825:0:5960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.928837:0:5960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.928846:0:5960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.928853:0:5960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.928871:0:5960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.928931:0:5960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783946831.929027:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a07e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:10501:x1870603507265152:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 770us (996us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1783946831.929036:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000020:00080000:2.0:1783946831.929042:0:5960:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783946831.931696:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507264896 00000100:00100000:0.0:1783946831.931713:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507264896 00000100:00100000:0.0:1783946831.931902:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:0.0:1783946831.931913:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:10500:x1870603507264896:12345-192.168.201.18@tcp:58:lfs.0 00000040:00080000:0.0:1783946831.932332:0:5956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1783946831.932426:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:10500:x1870603507264896:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 513us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946831.932434:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 131 00010000:00010000:1.0:1783946831.935648:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946831.935667:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.935680:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946831.935698:0:5945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.935708:0:5945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.935725:0:5945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:1.0:1783946831.935728:0:5945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783946831.935732:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.935738:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7b7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946831.935759:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946831.935761:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946831.935763:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946831.986389:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946831.986558:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507265280 00000100:00100000:3.0:1783946831.986569:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507265280 00000100:00100000:3.0:1783946831.986632:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 132 00000100:00100000:3.0:1783946831.986642:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:10503:x1870603507265280:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946831.986666:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946831.986686:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7b84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572051 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.986748:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.986764:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.986774:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.986789:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.986796:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946831.986821:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.987708:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.987738:0:5957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572012 expref: 21 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.987747:0:5957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.987783:0:5957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572012 expref: 21 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946831.987797:0:5957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572012 expref: 21 pid: 5958 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946831.987811:0:5957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be471180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523006336:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946831.987915:0:5957:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a36d8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783946832.002701:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946832.002872:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507265536 00000100:00100000:1.0:1783946832.002882:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507265536 00000100:00100000:1.0:1783946832.002945:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00080000:3.0:1783946832.002956:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946832.002957:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:5450:x1870603507265536:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783946832.003210:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:5450:x1870603507265536:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 256us (521us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1783946832.003219:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1783946832.003780:0:5957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be471180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523006336:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946832.003809:0:5957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946832.030141:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946832.030805:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507265664 00000100:00100000:1.0:1783946832.030817:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507265664 00010000:00010000:1.0:1783946832.031680:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572012 expref: 23 pid: 5958 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946832.031838:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:1.0:1783946832.031855:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:2362:x1870603507265664:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946832.031884:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946832.031891:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572012 expref: 23 pid: 5958 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946832.031905:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572012 expref: 23 pid: 5958 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946832.031928:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7aa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572012 expref: 23 pid: 5958 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946832.031945:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:1.0:1783946832.031950:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946832.031961:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946832.031968:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946832.032001:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946832.032095:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:2362:x1870603507265664:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 246us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946832.032102:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00010000:00010000:0.0:1783946832.032165:0:5957:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032173:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946832.032226:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783946832.032231:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946832.032250:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032263:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032272:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032285:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032292:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032297:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946832.032301:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032308:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032316:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:0.0:1783946832.032319:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946832.032323:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032328:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7b8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032353:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032358:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032363:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032368:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946832.032375:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032382:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032389:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9137983e1a00) 00010000:00010000:0.0:1783946832.032391:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946832.032393:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032399:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7b92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032436:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7b84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572051 expref: 22 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032450:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572051 expref: 21 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946832.032457:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:0.0:1783946832.032459:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946832.032462:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9200, rc 0) 00000100:00100000:0.0:1783946832.032486:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:10503:x1870603507265280:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 45846us (46109us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946832.032492:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 132 00010000:00010000:3.0:1783946832.144484:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783946832.611947:0:8015:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1783946832.611975:0:8015:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1783946832.752598:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946832.752674:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507265792 00000100:00100000:1.0:1783946832.752694:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507265792 00000100:00100000:1.0:1783946832.752757:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 297 00000100:00100000:1.0:1783946832.752777:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507265792:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946832.752850:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507265792:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 75us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946832.752859:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 297 00000100:00100000:1.0:1783946832.753360:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946832.753393:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946832.753414:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946832.753436:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946832.753458:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507266048 00000100:00100000:1.0:1783946832.753463:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507266048 00000100:00100000:1.0:1783946832.753506:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507266176 00000100:00100000:1.0:1783946832.753510:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507266176 00000100:00100000:1.0:1783946832.753539:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1783946832.753547:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507266048:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946832.753586:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507266048:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 39us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946832.753593:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1783946832.753608:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:1.0:1783946832.753614:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507266176:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946832.753638:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507266176:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946832.753643:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:1.0:1783946832.753674:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507265920 00000100:00100000:1.0:1783946832.753678:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507265920 00000100:00100000:1.0:1783946832.753700:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507266304 00000100:00100000:1.0:1783946832.753703:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507266304 00000100:00100000:1.0:1783946832.753725:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 155 00000100:00100000:1.0:1783946832.753731:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:2362:x1870603507265920:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946832.756253:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:2362:x1870603507265920:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 2508us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946832.756269:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 155 00000100:00100000:1.0:1783946832.756310:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 156 00000100:00100000:1.0:1783946832.756325:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507266304:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946832.756382:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507266304:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 63us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946832.756388:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 156 00000100:00080000:1.0:1783946832.756426:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783946832.756432:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1783946832.983389:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783946832.983401:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783946832.983444:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783946832.983452:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783946832.983638:0:12087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523006464:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783946832.983780:0:12087:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f35c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783946832.991695:0:12087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523006464:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783946833.016668:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946833.023667:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507266432 00000100:00100000:3.0:1783946833.023687:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507266432 00000100:00100000:3.0:1783946833.023770:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 133 00000100:00100000:3.0:1783946833.023784:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:10514:x1870603507266432:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783946833.023825:0:5956:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783946833.023988:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:10514:x1870603507266432:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 207us (7332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946833.023995:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 133 00000100:00100000:2.0:1783946833.035395:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946833.035541:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507266688 00000100:00100000:1.0:1783946833.035553:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507266688 00000100:00100000:1.0:1783946833.035628:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 134 00000100:00100000:1.0:1783946833.035640:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:10514:x1870603507266688:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783946833.035665:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946833.035690:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7ba0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572058 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946833.035813:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7ba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946833.035842:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946833.035856:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946833.035869:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783946833.035990:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7ba0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572058 expref: 24 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946833.036013:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572058 expref: 23 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946833.036022:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:1.0:1783946833.036025:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783946833.036029:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45e00, rc 0) 00000100:00100000:1.0:1783946833.036147:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:10514:x1870603507266688:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 508us (761us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1783946833.036155:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 134 00000100:00100000:1.0:1783946833.044288:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946833.044337:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946833.044402:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507267072 00000100:00100000:3.0:1783946833.044412:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507267072 00000100:00100000:3.0:1783946833.044499:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783946833.044510:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:2362:x1870603507267072:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946833.044526:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946833.044553:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7ba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572058 expref: 23 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.044568:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946833.044572:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946833.044634:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:2362:x1870603507267072:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 126us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946833.044656:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783946833.044683:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507266944 00000100:00100000:3.0:1783946833.044687:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507266944 00000100:00100000:3.0:1783946833.044713:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 135 00000100:00100000:3.0:1783946833.044721:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:10514:x1870603507266944:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783946833.044792:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.044806:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.044818:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.045174:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.045183:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.045190:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.045197:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946833.045201:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.045209:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.045217:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946833.045226:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783946833.045231:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.045238:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946833.045332:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:10514:x1870603507266944:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 611us (1052us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1783946833.045341:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 135 00000040:00080000:0.0:1783946833.045822:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783946833.045828:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783946833.046298:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783946833.046308:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783946833.051370:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946833.051591:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507267328 00000100:00100000:3.0:1783946833.051603:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507267328 00000100:00100000:3.0:1783946833.051674:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1783946833.051685:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:10514:x1870603507267328:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783946833.051951:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:10514:x1870603507267328:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 268us (591us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1783946833.051960:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000040:00080000:0.0:1783946833.161408:0:12447:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783946833.161420:0:12447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783946833.161453:0:12447:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783946833.161459:0:12447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783946833.170322:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946833.484024:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946833.484252:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507267584 00000100:00100000:2.0:1783946833.484264:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507267584 00000100:00100000:2.0:1783946833.484331:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 136 00000100:00100000:2.0:1783946833.484341:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:10527:x1870603507267584:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946833.484365:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946833.484384:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7bbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57205f expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946833.484575:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8c00/0x229d2ec450db7bc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946833.484601:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8c00/0x229d2ec450db7bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946833.484613:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8c00/0x229d2ec450db7bc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946833.484626:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783946833.484940:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7bbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57205f expref: 27 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946833.484960:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8c00/0x229d2ec450db7bc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57205f expref: 26 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946833.484970:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:2.0:1783946833.484973:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783946833.484977:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8c00, rc 0) 00000100:00100000:2.0:1783946833.485051:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:10527:x1870603507267584:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 712us (1037us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1783946833.485244:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 136 00000100:00100000:3.0:1783946833.489103:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946833.489155:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507267712 00000100:00100000:3.0:1783946833.489165:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507267712 00000100:00100000:3.0:1783946833.489220:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 137 00000100:00100000:3.0:1783946833.489232:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:10527:x1870603507267712:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1783946833.489316:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.489338:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.489360:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.489395:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.489401:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.489408:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.489414:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946833.489430:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.489438:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.489451:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:3.0:1783946833.489454:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783946833.489459:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946833.489465:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7bd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946833.489558:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:10527:x1870603507267712:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 327us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946833.489566:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 137 00000100:00100000:0.0:1783946833.616424:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946833.617095:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507267840 00000100:00100000:1.0:1783946833.617108:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507267840 00000100:00100000:1.0:1783946833.617197:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:1.0:1783946833.617209:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507267840:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:1.0:1783946833.617241:0:9002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946833.617261:0:9002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2560613/0x229d2ec450db7bd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572066 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783946833.617283:0:9002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a54de4f, atime: 0x6a54de4f, ctime: 0x6a54de4f, blocks: 0x8 00010000:00010000:1.0:1783946833.617303:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1783946833.617308:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946833.617317:0:9002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2560613/0x229d2ec450db7bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572066 expref: 7 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946833.617335:0:9002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2560613/0x229d2ec450db7bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572066 expref: 7 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946833.617347:0:9002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45400, rc 0) 00000100:00100000:1.0:1783946833.617417:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507267840:12345-192.168.201.18@tcp:101:cat.0 Request processed in 212us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946833.617425:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00080000:3.0:1783946833.617516:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946833.623967:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946833.624111:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507267968 00000100:00100000:0.0:1783946833.624123:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507267968 00002000:00100000:0.0:1783946833.624184:0:6950:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9137be7bce00 x1870603507267968/t0(0) o3->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:379/0 lens 488/0 e 0 to 0 dl 1783946844 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783946833.624192:0:6950:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be7bce00 with x1870603507267968 ext(0->4095) 00002000:00010000:0.0:1783946833.624197:0:6950:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be7bce00 00000100:00100000:0.0:1783946833.624228:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:0.0:1783946833.624236:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507267968:12345-192.168.201.18@tcp:3:cat.0 00000100:00100000:0.0:1783946833.624513:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507267968:12345-192.168.201.18@tcp:3:cat.0 Request processed in 275us (558us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783946833.624523:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00002000:00100000:0.0:1783946833.624530:0:6950:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9137be7bce00 x1870603507267968/t0(0) o3->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:379/0 lens 488/4536 e 0 to 0 dl 1783946844 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783946833.624538:0:6950:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be7bce00 with x1870603507267968 ext(0->4095) 00002000:00010000:0.0:1783946833.624557:0:6950:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be7bce00 00010000:00010000:3.0:1783946834.192291:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946834.833163:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523006592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946834.833239:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946834.833384:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523006592 00000100:00100000:2.0:1783946834.833394:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523006592 00000100:00100000:2.0:1783946834.833488:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783946834.833500:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3448:x1870603523006592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783946834.833533:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:2.0:1783946834.833598:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3448:x1870603523006592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946834.833606:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783946834.833682:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523006592:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783946834.834023:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783946835.222704:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946835.856836:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783946835.857561:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523006976:0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.857679:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946835.857784:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783946835.857791:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523007104:0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.857816:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946835.857870:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523006976 00000100:00100000:3.0:1783946835.857879:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523006976 00000100:00100000:3.0:1783946835.857962:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523007104 00000100:00100000:3.0:1783946835.857966:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523007104 00000100:00100000:3.0:1783946835.858003:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783946835.858013:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523006976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.858098:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523006976:12345-0@lo:400:kworker.0 Request processed in 86us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946835.858107:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783946835.858131:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783946835.858137:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523007104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.858166:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523007104:12345-0@lo:400:kworker.0 Request processed in 29us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946835.858172:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1783946835.858197:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946835.858214:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523007232:0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.858247:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946835.858298:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946835.858305:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523006848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946835.858334:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946835.858388:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523007104:0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.858401:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523006976:0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.858748:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523006848 00000100:00100000:3.0:1783946835.858754:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523006848 00000100:00100000:3.0:1783946835.858801:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783946835.858809:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523006848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783946835.858838:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946835.858881:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523006848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946835.858888:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1783946835.858903:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783946835.858920:0:3449:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1783946835.858927:0:3449:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1783946835.858947:0:3449:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be54ad80, transno 4294967301 00000004:00080000:3.0:1783946835.858960:0:3449:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1783946835.858974:0:3449:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137bde8f100, transno 4294967304 00000100:00100000:3.0:1783946835.858987:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523006848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946835.859219:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523007232 00000100:00100000:3.0:1783946835.859224:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523007232 00000100:00100000:3.0:1783946835.859256:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783946835.859264:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603523007232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.859307:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603523007232:12345-0@lo:400:kworker.0 Request processed in 43us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946835.859329:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783946835.859360:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523007232:0@lo:400:kworker.0 00000100:00100000:0.0:1783946835.860591:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523006720:0@lo:400:kworker.0 00000100:00100000:0.0:1783946835.860766:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946835.860824:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523006720 00000100:00100000:3.0:1783946835.860837:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523006720 00000100:00100000:3.0:1783946835.860924:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1783946835.860937:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603523006720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.861018:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603523006720:12345-0@lo:400:kworker.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946835.861026:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1783946835.862043:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523006720:0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.863612:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946835.863873:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523007360:0@lo:400:kworker.0 00000100:00100000:3.0:1783946835.864107:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946835.864238:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523007360 00000100:00100000:0.0:1783946835.864247:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523007360 00000100:00100000:0.0:1783946835.864382:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783946835.864393:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523007360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946835.864497:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523007360:12345-0@lo:400:kworker.0 Request processed in 105us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946835.864506:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783946835.864657:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523007360:0@lo:400:kworker.0 00000100:00080000:3.0:1783946835.864834:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783946836.241153:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946837.264543:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946837.873805:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946837.873896:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946837.873928:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946837.873974:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946837.874002:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946837.874036:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507268352 00000100:00100000:0.0:1783946837.874046:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507268352 00000100:00100000:0.0:1783946837.874151:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507268480 00000100:00100000:0.0:1783946837.874155:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507268480 00000100:00100000:0.0:1783946837.874198:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:0.0:1783946837.874209:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507268352:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946837.874298:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507268352:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 90us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946837.874306:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:0.0:1783946837.874324:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:0.0:1783946837.874339:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507268480:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946837.874366:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507268480:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946837.874372:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00080000:0.0:1783946837.874391:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783946837.874405:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783946837.874542:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507268608 00000100:00100000:0.0:1783946837.874547:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507268608 00000100:00100000:0.0:1783946837.874579:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507268224 00000100:00100000:0.0:1783946837.874582:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507268224 00000100:00100000:0.0:1783946837.874605:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 160 00000100:00100000:0.0:1783946837.874612:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507268608:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946837.874645:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507268608:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 34us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946837.874652:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 160 00000100:00100000:0.0:1783946837.874665:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00100000:0.0:1783946837.874671:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:2364:x1870603507268224:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946837.874694:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:2364:x1870603507268224:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946837.874700:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00080000:0.0:1783946837.874742:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946837.877933:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507268096 00000100:00100000:3.0:1783946837.877960:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507268096 00000100:00100000:0.0:1783946837.878427:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 299 00000100:00100000:0.0:1783946837.878438:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507268096:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946837.878528:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507268096:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 91us (4732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946837.878553:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 299 00000001:00080000:1.0:1783946837.908337:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1783946837.908368:0:5935:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9137bdd77780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1783946837.908375:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137be329900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9137bdd77f00 00000020:00080000:1.0:1783946837.908379:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137be329400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9137be69ce00 00000020:00080000:1.0:1783946837.908413:0:5935:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1783946837.908479:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1783946837.908551:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1783946837.908833:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1783946837.908841:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:3.0:1783946838.288373:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783946839.186142:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783946839.186154:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783946839.186174:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783946839.186181:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783946839.319208:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946839.918186:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946839.922013:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507268736 00000100:00100000:3.0:1783946839.922034:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507268736 00000100:00100000:3.0:1783946839.922195:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 138 00000100:00100000:3.0:1783946839.922212:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10188:x1870603507268736:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783946839.922372:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10188:x1870603507268736:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 Request processed in 158us (4188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946839.922381:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 138 00000100:00080000:0.0:1783946839.924027:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946839.942758:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946839.962219:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507268992 00000100:00100000:2.0:1783946839.962237:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507268992 00000100:00100000:2.0:1783946839.962323:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:2.0:1783946839.962337:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:10188:x1870603507268992:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783946839.962640:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:10188:x1870603507268992:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 305us (19891us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1783946839.962649:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:3.0:1783946839.963431:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523007488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946839.963508:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946839.964009:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523007488 00000100:00100000:0.0:1783946839.964016:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523007488 00000100:00100000:0.0:1783946839.964113:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783946839.964123:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523007488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946839.964150:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:0.0:1783946839.964199:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523007488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946839.964206:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783946839.964249:0:3447:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1783946839.964256:0:3447:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1783946839.964283:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523007488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783946839.964423:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783946840.336512:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946840.362237:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946840.363250:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507269120 00000100:00100000:0.0:1783946840.363263:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507269120 00000100:00100000:0.0:1783946840.363350:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 139 00000100:00100000:0.0:1783946840.363373:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:10980:x1870603507269120:12345-192.168.201.18@tcp:101:lsof.0 00010000:00010000:0.0:1783946840.363403:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946840.363426:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7bdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57206d expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946840.363495:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946840.363530:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946840.363542:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946840.363837:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783946840.363842:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946840.363886:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946840.363911:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7bdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57206d expref: 7 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946840.363932:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57206d expref: 6 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946840.363942:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:0.0:1783946840.363945:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783946840.363948:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8c00, rc 0) 00000100:00100000:0.0:1783946840.364032:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+6:10980:x1870603507269120:12345-192.168.201.18@tcp:101:lsof.0 Request processed in 661us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946840.364040:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 139 00000100:00080000:3.0:1783946840.364169:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946840.976562:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523008000:0@lo:400:kworker.0 00000100:00100000:0.0:1783946840.976668:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946840.976751:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783946840.976757:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523007616:0@lo:400:kworker.0 00000100:00100000:0.0:1783946840.976785:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946840.976826:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523008128:0@lo:400:kworker.0 00000100:00100000:0.0:1783946840.976852:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946840.976883:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523007616 00000100:00100000:0.0:1783946840.976890:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523007616 00000100:00100000:0.0:1783946840.976938:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1783946840.976947:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523007616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946840.977014:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523007616:12345-0@lo:400:kworker.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946840.977022:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1783946840.977119:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523007616:0@lo:400:kworker.0 00000100:00100000:2.0:1783946840.977355:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523008000 00000100:00100000:2.0:1783946840.977360:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523008000 00000100:00100000:2.0:1783946840.977403:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783946840.977410:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523008000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946840.977450:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523008000:12345-0@lo:400:kworker.0 Request processed in 41us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946840.977456:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783946840.977881:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137812e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523007744:0@lo:400:kworker.0 00000100:00100000:1.0:1783946840.977915:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946840.977952:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523008256:0@lo:400:kworker.0 00000100:00100000:1.0:1783946840.977974:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946840.977987:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523008128 00000100:00100000:3.0:1783946840.977994:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523008128 00000100:00100000:1.0:1783946840.978008:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783946840.978016:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523007872:0@lo:400:kworker.0 00000100:00100000:3.0:1783946840.978039:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523007744 00000100:00100000:1.0:1783946840.978039:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946840.978045:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523007744 00000100:00100000:1.0:1783946840.978084:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523008384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946840.978086:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523007872 00000100:00100000:3.0:1783946840.978091:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523007872 00000100:00100000:3.0:1783946840.978117:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783946840.978118:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946840.978130:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523008128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946840.978156:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783946840.978168:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523007744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946840.978178:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523008128:12345-0@lo:400:kworker.0 Request processed in 51us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946840.978186:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783946840.978207:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783946840.978212:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523007744:12345-0@lo:400:kworker.0 Request processed in 46us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946840.978218:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523007872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946840.978225:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783946840.978256:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523008384 00000100:00100000:3.0:1783946840.978261:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523007872:12345-0@lo:400:kworker.0 Request processed in 45us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946840.978262:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523008384 00000100:00100000:3.0:1783946840.978271:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783946840.978300:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1783946840.978305:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946840.978309:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523008384:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783946840.978311:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:1.0:1783946840.978335:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946840.978389:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523008384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946840.978395:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783946840.978425:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523007872:0@lo:400:kworker.0 00000100:00100000:1.0:1783946840.978438:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523008384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946840.978447:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137812e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523007744:0@lo:400:kworker.0 00000100:00100000:0.0:1783946840.978775:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523008256 00000100:00100000:0.0:1783946840.978781:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523008256 00000100:00100000:0.0:1783946840.978816:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783946840.978824:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523008256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946840.978876:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523008256:12345-0@lo:400:kworker.0 Request processed in 52us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946840.978882:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783946840.978918:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523008128:0@lo:400:kworker.0 00000100:00100000:0.0:1783946840.978930:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523008000:0@lo:400:kworker.0 00000100:00100000:3.0:1783946840.979926:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523008256:0@lo:400:kworker.0 00010000:00010000:2.0:1783946841.360289:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946842.385016:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946842.997377:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946842.997475:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946842.997530:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946842.997558:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946842.997583:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946842.997632:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507269248 00000100:00100000:3.0:1783946842.997642:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507269248 00000100:00100000:3.0:1783946842.997692:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 301 00000100:00100000:3.0:1783946842.997701:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507269248:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946842.997776:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507269248:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946842.997790:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 301 00000100:00100000:0.0:1783946842.998406:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507269632 00000100:00100000:0.0:1783946842.998413:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507269632 00000100:00100000:0.0:1783946842.998471:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507269504 00000100:00100000:0.0:1783946842.998475:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507269504 00000100:00100000:0.0:1783946842.998500:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:0.0:1783946842.998508:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507269632:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946842.998549:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507269632:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 42us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946842.998564:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:0.0:1783946842.998577:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:0.0:1783946842.998583:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507269504:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946842.998607:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507269504:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946842.998613:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00080000:3.0:1783946842.999565:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783946842.999575:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783946843.002870:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507269376 00000100:00100000:2.0:1783946843.002894:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507269376 00000100:00100000:2.0:1783946843.003030:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507269760 00000100:00100000:2.0:1783946843.003034:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507269760 00000100:00100000:0.0:1783946843.003369:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:0.0:1783946843.003385:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:2364:x1870603507269376:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946843.004286:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:2364:x1870603507269376:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 902us (6915us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946843.004297:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00080000:3.0:1783946843.004943:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946843.005389:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:2.0:1783946843.005403:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:2364:x1870603507269760:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946843.005940:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:2364:x1870603507269760:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 539us (8352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946843.005948:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 166 00010000:00010000:2.0:1783946843.410235:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783946844.057640:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1783946844.057658:0:5935:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1783946844.057724:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1783946844.057737:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1783946844.438193:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946845.087324:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523008512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946845.087438:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946845.087714:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523008512 00000100:00100000:1.0:1783946845.087725:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523008512 00000100:00100000:1.0:1783946845.087810:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783946845.087822:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523008512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946845.087863:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:1.0:1783946845.087922:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523008512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946845.087930:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1783946845.087998:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783946845.088050:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523008512:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1783946845.150706:0:12645:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:47:23 (1783946843) 00010000:00010000:2.0:1783946845.456307:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946846.096849:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946846.096879:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523008640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946846.096975:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946846.097537:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523008640 00000100:00100000:1.0:1783946846.097549:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523008640 00000100:00100000:1.0:1783946846.097628:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783946846.097641:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523008640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946846.097686:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946846.097749:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523008640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946846.097757:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783946846.097787:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523008896:0@lo:400:kworker.0 00000100:00100000:1.0:1783946846.097838:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946846.097873:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783946846.097879:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523008768:0@lo:400:kworker.0 00000100:00100000:1.0:1783946846.097912:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946846.097959:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603523009280:0@lo:400:kworker.0 00000100:00100000:1.0:1783946846.097983:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946846.098021:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523008896 00000100:00100000:1.0:1783946846.098025:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523008896 00000100:00100000:1.0:1783946846.098053:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523009280 00000100:00100000:1.0:1783946846.098056:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523009280 00000100:00100000:1.0:1783946846.098112:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783946846.098119:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523008896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946846.098158:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523008896:12345-0@lo:400:kworker.0 Request processed in 40us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946846.098165:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783946846.098179:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783946846.098186:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603523009280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946846.098501:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523009152:0@lo:400:kworker.0 00000100:00100000:0.0:1783946846.098557:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946846.098583:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783946846.098590:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603523009024:0@lo:400:kworker.0 00000100:00100000:0.0:1783946846.098614:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946846.098639:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523009152 00000100:00100000:0.0:1783946846.098643:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523009152 00000100:00100000:0.0:1783946846.098677:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783946846.098684:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523009152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946846.098731:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523009152:12345-0@lo:400:kworker.0 Request processed in 47us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946846.098739:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783946846.098783:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523009152:0@lo:400:kworker.0 00000100:00100000:0.0:1783946846.098840:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523009024 00000100:00100000:0.0:1783946846.098844:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523009024 00000100:00100000:0.0:1783946846.098865:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783946846.098871:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603523009024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946846.098903:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603523009024:12345-0@lo:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946846.098909:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783946846.098928:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523008768 00000100:00100000:0.0:1783946846.098930:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523008768 00000100:00100000:0.0:1783946846.098957:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783946846.098964:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603523008768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946846.098992:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603523008768:12345-0@lo:400:kworker.0 Request processed in 29us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946846.098998:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783946846.099031:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603523009024:0@lo:400:kworker.0 00000100:00100000:0.0:1783946846.099103:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be23dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523008768:0@lo:400:kworker.0 00000100:00100000:0.0:1783946846.099114:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523008896:0@lo:400:kworker.0 00000100:00100000:1.0:1783946846.099460:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603523009280:12345-0@lo:400:kworker.0 Request processed in 1273us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946846.099468:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783946846.099599:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523008640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946846.099690:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bde8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603523009280:0@lo:400:kworker.0 00000100:00080000:3.0:1783946846.099765:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783946846.099774:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783946846.489456:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946847.074227:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946847.074857:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507270016 00000100:00100000:0.0:1783946847.074874:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507270016 00000100:00100000:0.0:1783946847.074995:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 140 00000100:00100000:0.0:1783946847.075009:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:11245:x1870603507270016:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783946847.075045:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946847.075127:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7bed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572074 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075252:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075271:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075285:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075313:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075322:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075329:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075459:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7c02 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075469:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7c02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075476:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7c02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946847.075500:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783946847.075627:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075635:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075643:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075649:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946847.075654:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075663:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075678:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9137927b9f00) 00010000:00010000:0.0:1783946847.075682:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946847.075687:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075951:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7bf4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075971:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075977:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.075995:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.076000:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946847.076003:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.076009:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.076017:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9137be239100) 00010000:00010000:0.0:1783946847.076020:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946847.076023:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.076029:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7bfb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783946847.080283:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783946847.081503:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7bed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572074 expref: 16 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.081550:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7c02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572074 expref: 15 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946847.081561:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:0.0:1783946847.081565:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946847.081569:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8600, rc 0) 00000100:00100000:0.0:1783946847.082931:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:11245:x1870603507270016:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 7509us (8300us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1783946847.082975:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 140 00000100:00100000:0.0:1783946847.101460:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946847.101657:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507270144 00000100:00100000:1.0:1783946847.101671:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507270144 00000100:00100000:1.0:1783946847.101775:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1783946847.101787:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:2364:x1870603507270144:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946847.102126:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946847.102165:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7c02 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572074 expref: 15 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946847.102547:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:1.0:1783946847.102573:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946847.102655:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:2364:x1870603507270144:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 868us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946847.102670:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1783946847.102761:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946847.103006:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507270272 00000100:00100000:2.0:1783946847.103013:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507270272 00000100:00100000:2.0:1783946847.103092:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 141 00000100:00100000:2.0:1783946847.103103:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:11245:x1870603507270272:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783946847.103202:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:11245:x1870603507270272:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 Request processed in 101us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946847.103210:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 141 00000040:00080000:0.0:1783946847.376443:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783946847.376458:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783946847.376960:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783946847.376977:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783946847.507643:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946848.115960:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946848.116022:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946848.116048:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946848.116096:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946848.116123:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946848.116149:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507270656 00000100:00100000:0.0:1783946848.116157:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507270656 00000100:00100000:0.0:1783946848.116214:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507270784 00000100:00100000:0.0:1783946848.116218:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507270784 00000100:00100000:0.0:1783946848.116253:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:0.0:1783946848.116385:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507270656:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946848.116471:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507270656:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 80us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946848.116480:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:0.0:1783946848.116497:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:0.0:1783946848.116504:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507270784:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946848.116528:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2363:x1870603507270784:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946848.116534:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:0.0:1783946848.116565:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507270912 00000100:00100000:0.0:1783946848.116569:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507270912 00000100:00100000:0.0:1783946848.116599:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507270528 00000100:00100000:0.0:1783946848.116602:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507270528 00000100:00100000:0.0:1783946848.116620:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:0.0:1783946848.116627:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+6:2363:x1870603507270912:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946848.116655:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+6:2363:x1870603507270912:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946848.116662:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:0.0:1783946848.116673:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:0.0:1783946848.116679:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:2363:x1870603507270528:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946848.116703:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:2363:x1870603507270528:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946848.116709:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00080000:0.0:1783946848.116732:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783946848.116737:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783946848.116739:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946848.117951:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507270400 00000100:00100000:3.0:1783946848.117960:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507270400 00000100:00100000:3.0:1783946848.124946:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 303 00000100:00100000:3.0:1783946848.124968:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507270400:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946848.125142:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507270400:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 181us (9190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946848.125151:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 303 00010000:00010000:1.0:1783946848.528380:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946849.161166:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946849.161213:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507271040 00000100:00100000:3.0:1783946849.161223:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507271040 00000100:00100000:3.0:1783946849.161685:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 142 00000100:00100000:3.0:1783946849.161696:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:11287:x1870603507271040:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946849.161718:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946849.161741:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57207b expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.161810:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.161949:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.161964:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.161981:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.161987:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.161993:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162043:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162049:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162055:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162122:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946849.162127:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162135:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162148:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:3.0:1783946849.162156:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946849.162161:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162168:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7c17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162181:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162186:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162192:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162196:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946849.162198:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162216:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162222:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9137983e1600) 00010000:00010000:3.0:1783946849.162225:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946849.162227:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162241:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162277:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57207b expref: 15 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162296:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:3.0:1783946849.162299:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946849.162302:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57207b expref: 15 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.162542:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031200, rc 0) 00000100:00100000:3.0:1783946849.162639:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:11287:x1870603507271040:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 944us (1483us total) trans 0 rc 301/301 00000100:00100000:3.0:1783946849.162647:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 142 00000100:00080000:1.0:1783946849.174864:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946849.183023:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946849.183081:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507271296 00000100:00100000:1.0:1783946849.183091:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507271296 00000100:00100000:1.0:1783946849.183146:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 143 00000100:00100000:1.0:1783946849.183156:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:11287:x1870603507271296:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:1.0:1783946849.183221:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946849.183251:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7564 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e9f expref: 14 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.183270:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:1.0:1783946849.183275:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783946849.183344:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.183359:0:7190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57206d expref: 5 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.183369:0:7190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.183426:0:7190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57206d expref: 5 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.183450:0:7190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57206d expref: 5 pid: 5958 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946849.183465:0:7190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523009408:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783946849.183554:0:7190:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780240 going to sleep for 11 seconds 00000100:00100000:2.0:1783946849.198140:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946849.199277:0:7190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523009408:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946849.199307:0:7190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946849.199356:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507271424 00000100:00100000:3.0:1783946849.199364:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507271424 00010000:00010000:3.0:1783946849.199405:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57206d expref: 6 pid: 5958 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946849.199460:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:3.0:1783946849.199470:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5851e04-311c-4929-a2c6-87673cd4c005+6:2362:x1870603507271424:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946849.199485:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946849.199493:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57206d expref: 6 pid: 5958 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.199506:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57206d expref: 6 pid: 5958 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.199539:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7be6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57206d expref: 6 pid: 5958 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.199554:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:3.0:1783946849.199559:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.199568:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.199575:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.199598:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946849.199665:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507271424:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 187us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946849.201334:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00010000:00010000:3.0:1783946849.201481:0:7190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.201493:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.201524:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.201537:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.201548:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946849.204360:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783946849.204383:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.204394:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.204401:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.204407:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946849.204412:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.204419:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.204434:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff913797609c00) 00010000:00010000:3.0:1783946849.204438:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946849.204442:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.204448:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c25 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783946849.204466:0:7190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d187a9a3 reply state 0000000045d7a85c transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946849.204474:0:7190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783946849.204566:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:11287:x1870603507271296:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 21408us (21549us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1783946849.204584:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 143 00010000:00010000:1.0:1783946849.211281:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.211302:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.211309:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.211317:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946849.211323:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.211331:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.211350:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9137983e1600) 00010000:00010000:1.0:1783946849.211353:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946849.211358:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.211364:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7c2c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946849.316245:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946849.316375:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507271552 00000100:00100000:0.0:1783946849.316388:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507271552 00000100:00100000:0.0:1783946849.316471:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00100000:0.0:1783946849.316483:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+14:11296:x1870603507271552:12345-192.168.201.18@tcp:101:lctl.0 00010000:00010000:0.0:1783946849.316520:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946849.316554:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7c33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572082 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.316638:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7c3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.316674:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.316691:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946849.316752:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783946849.316757:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946849.316784:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7c3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.316812:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7c33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572082 expref: 16 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.316833:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7c3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572082 expref: 15 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.316843:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be239100) 00010000:00010000:0.0:1783946849.316847:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783946849.316851:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9e00, rc 0) 00000100:00100000:0.0:1783946849.316946:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:11296:x1870603507271552:12345-192.168.201.18@tcp:101:lctl.0 Request processed in 463us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946849.316954:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00100000:3.0:1783946849.396019:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946849.396239:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507271680 00000100:00100000:1.0:1783946849.396253:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507271680 00000100:00100000:1.0:1783946849.396336:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 145 00000100:00100000:1.0:1783946849.396349:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+15:11302:x1870603507271680:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1783946849.396378:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946849.396406:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7c41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572089 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396489:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396506:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396519:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396538:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396545:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396551:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396671:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396679:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396706:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946849.396757:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783946849.396761:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783946849.396785:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396799:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396806:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396814:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396820:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946849.396825:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396833:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396847:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be239100) 00010000:00010000:1.0:1783946849.396850:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946849.396856:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.396993:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397022:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397028:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397035:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397040:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946849.397043:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397050:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397122:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9137979fe600) 00010000:00010000:1.0:1783946849.397125:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946849.397129:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397135:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7c4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397171:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db7c41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572089 expref: 17 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397186:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572089 expref: 16 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.397216:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:1.0:1783946849.397219:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783946849.397222:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44800, rc 0) 00000100:00100000:1.0:1783946849.397320:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:11302:x1870603507271680:12345-192.168.201.18@tcp:101:bash.0 Request processed in 973us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946849.397328:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 145 00000100:00100000:1.0:1783946849.405110:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946849.405248:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507271936 00000100:00100000:0.0:1783946849.405262:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507271936 00000100:00100000:0.0:1783946849.405338:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 146 00000100:00100000:0.0:1783946849.405359:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+16:11302:x1870603507271936:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946849.405386:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946849.405436:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7c5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572090 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.405595:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.405613:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.405628:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.406218:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.406292:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.406303:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783946849.407818:0:5957:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1783946849.408046:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408091:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408106:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408148:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408171:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408177:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408181:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946849.408185:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408191:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408217:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:0.0:1783946849.408221:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946849.408227:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408238:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7c64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783946849.408257:0:5957:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080fe9380 reply state 0000000085bdc446 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946849.408268:0:5957:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783946849.408318:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7c5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572090 expref: 19 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408335:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572090 expref: 18 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.408356:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be239300) 00010000:00010000:0.0:1783946849.408359:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946849.408361:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9800, rc 0) 00000100:00100000:0.0:1783946849.410496:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11302:x1870603507271936:12345-192.168.201.18@tcp:101:bash.0 Request processed in 5120us (5383us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783946849.410514:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 146 00010000:00010000:3.0:1783946849.418006:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.418031:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.418041:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.418048:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946849.418054:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.418113:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.418136:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137be239800) 00010000:00010000:3.0:1783946849.418139:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946849.418145:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.418151:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7c6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946849.423472:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946849.423590:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507272064 00000100:00100000:0.0:1783946849.423605:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507272064 00000100:00100000:0.0:1783946849.423706:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:0.0:1783946849.423719:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2364:x1870603507272064:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946849.423746:0:6945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946849.423780:0:6945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572097 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783946849.423816:0:6945:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946849.423855:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1783946849.423869:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946849.423883:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572097 expref: 6 pid: 6945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.423908:0:6945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572097 expref: 6 pid: 6945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.423925:0:6945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8e00, rc 0) 00000100:00100000:0.0:1783946849.424008:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2364:x1870603507272064:12345-192.168.201.18@tcp:101:bash.0 Request processed in 292us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946849.424033:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000040:00080000:1.0:1783946849.425308:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783946849.425322:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783946849.425482:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1783946849.425490:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783946849.429901:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.430264:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507272192 00000100:00100000:2.0:1783946849.430278:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507272192 00000100:00100000:2.0:1783946849.430406:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:2.0:1783946849.430419:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:11302:x1870603507272192:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946849.430444:0:6942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946849.430470:0:6942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57209e expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.430514:0:6942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572097 expref: 7 pid: 6945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.430524:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946849.430530:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946849.430536:0:6942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 7 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.430606:0:6942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572097 expref: 7 pid: 6945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.430624:0:6942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572097 expref: 7 pid: 6945 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946849.430655:0:6942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6942:1870603523009536:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946849.430797:0:6942:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028480 going to sleep for 11 seconds 00000100:00100000:3.0:1783946849.434213:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.434246:0:6942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6942:1870603523009536:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946849.434313:0:6942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 7 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.434341:0:6942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9000, rc 0) 00000100:00100000:1.0:1783946849.434413:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507272320 00000100:00100000:1.0:1783946849.434422:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507272320 00000100:00100000:2.0:1783946849.434431:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:11302:x1870603507272192:12345-192.168.201.18@tcp:101:bash.0 Request processed in 4016us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946849.434441:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00010000:00010000:1.0:1783946849.434472:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572097 expref: 7 pid: 6945 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946849.434513:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:1.0:1783946849.434524:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507272320:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946849.434544:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946849.434573:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572097 expref: 7 pid: 6945 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.434589:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572097 expref: 7 pid: 6945 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.434634:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db7c80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572097 expref: 7 pid: 6945 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.434662:0:5941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946849.434668:0:5941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946849.434678:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 6 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.434691:0:5941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 6 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.434737:0:5941:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 6 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946849.434754:0:5941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be846300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5941:1870603523009664:192.168.201.18@tcp:105: 00000100:00100000:1.0:1783946849.434823:0:5941:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783946849.438940:0:5941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be846300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5941:1870603523009664:192.168.201.18@tcp:105: 00010000:00010000:3.0:1783946849.438986:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946849.439118:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507272320:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 4594us (4930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946849.439132:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:2.0:1783946849.440123:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946849.441897:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507272576 00000100:00100000:3.0:1783946849.441921:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507272576 00000100:00100000:2.0:1783946849.442078:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:2.0:1783946849.442092:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11302:x1870603507272576:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1783946849.442925:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11302:x1870603507272576:12345-192.168.201.18@tcp:35:bash.0 Request processed in 829us (2801us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1783946849.442937:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:2.0:1783946849.520609:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946849.524594:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507272832 00000100:00100000:1.0:1783946849.524614:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507272832 00000100:00100000:1.0:1783946849.524729:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 147 00000100:00100000:1.0:1783946849.524744:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11312:x1870603507272832:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1783946849.524783:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946849.524815:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720a5 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946849.524968:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783946849.525214:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720a5 expref: 21 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.525244:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be239100) 00010000:00010000:1.0:1783946849.525249:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783946849.525257:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7c8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720a5 expref: 21 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946849.525279:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45800, rc 0) 00000100:00100000:2.0:1783946849.525458:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:11312:x1870603507272832:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 715us (4862us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1783946849.525477:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 147 00000100:00100000:1.0:1783946849.527869:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.528257:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507273088 00000100:00100000:2.0:1783946849.528270:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507273088 00000100:00100000:2.0:1783946849.528351:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:2.0:1783946849.528364:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:11312:x1870603507273088:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946849.528701:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:11312:x1870603507273088:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 338us (847us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1783946849.528710:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00010000:00010000:0.0:1783946849.556967:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946849.601277:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946849.601403:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507273216 00000100:00100000:3.0:1783946849.601417:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507273216 00000100:00100000:3.0:1783946849.601493:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00100000:3.0:1783946849.601506:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:11318:x1870603507273216:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946849.601538:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946849.601565:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720ac expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.601655:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7ca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.601673:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.601686:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946849.601742:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783946849.601747:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946849.601769:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.601802:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7c9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720ac expref: 23 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.601827:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720ac expref: 22 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.601872:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:3.0:1783946849.601876:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946849.601881:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030200, rc 0) 00000100:00100000:3.0:1783946849.602182:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:11318:x1870603507273216:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 677us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946849.602191:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00100000:0.0:1783946849.606701:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.607039:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507273472 00000100:00100000:2.0:1783946849.607131:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507273472 00000100:00100000:2.0:1783946849.607206:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 149 00000100:00100000:2.0:1783946849.607221:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:11318:x1870603507273472:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946849.607251:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946849.607280:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7caa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720b3 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.607431:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7cb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.607451:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.607466:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946849.607480:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783946849.607612:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7caa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720b3 expref: 25 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.607629:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720b3 expref: 24 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.607638:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be239300) 00010000:00010000:2.0:1783946849.607640:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946849.607644:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9a00, rc 0) 00000100:00100000:2.0:1783946849.607784:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:11318:x1870603507273472:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 565us (1097us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1783946849.607793:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 149 00000100:00100000:2.0:1783946849.619929:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.619999:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946849.620284:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507273856 00000100:00100000:0.0:1783946849.620298:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507273856 00000100:00100000:0.0:1783946849.620394:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1783946849.620407:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:2361:x1870603507273856:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946849.620439:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946849.620484:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7cb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720b3 expref: 24 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.620511:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be239300) 00010000:00010000:0.0:1783946849.620517:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946849.620605:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:2361:x1870603507273856:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 200us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946849.620614:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1783946849.622575:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507273728 00000100:00100000:3.0:1783946849.622595:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507273728 00000100:00100000:3.0:1783946849.622673:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 150 00000100:00100000:3.0:1783946849.622686:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:11318:x1870603507273728:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946849.622724:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946849.622757:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7cbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720ba expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.624567:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7cc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.624597:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.624612:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946849.624631:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783946849.624824:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7cbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720ba expref: 26 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.626431:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720ba expref: 25 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.626448:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be239300) 00010000:00010000:3.0:1783946849.626452:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783946849.626458:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030e00, rc 0) 00000100:00100000:2.0:1783946849.626687:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+25:11318:x1870603507273728:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 4000us (6771us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1783946849.626699:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 150 00000100:00100000:2.0:1783946849.636375:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946849.636522:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507273984 00000100:00100000:0.0:1783946849.636537:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507273984 00000100:00100000:0.0:1783946849.636661:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:0.0:1783946849.636675:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2363:x1870603507273984:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:0.0:1783946849.636742:0:6945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.636770:0:6945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 6 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.636813:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946849.636820:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946849.636825:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.636882:0:6945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 6 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.636910:0:6945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 6 pid: 6942 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946849.636933:0:6945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6945:1870603523009792:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946849.638022:0:6945:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ad7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783946849.641357:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946849.641536:0:6950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507274112 00000100:00100000:3.0:1783946849.641550:0:6950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507274112 00002000:00100000:3.0:1783946849.641623:0:6950:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9137be4caa00 x1870603507274112/t0(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:395/0 lens 504/0 e 0 to 0 dl 1783946860 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783946849.641636:0:6950:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be4caa00 with x1870603507274112 ext(0->12) 00010000:00010000:3.0:1783946849.641650:0:6950:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 7 pid: 6942 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.641672:0:6950:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 7 pid: 6942 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783946849.641682:0:6950:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9137be4caa00 00000100:00100000:3.0:1783946849.641727:0:6950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1783946849.641739:0:6950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507274112:12345-192.168.201.18@tcp:4:lfs.0 00000100:00100000:2.0:1783946849.642851:0:6945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6945:1870603523009792:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946849.642901:0:6945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946849.643420:0:6950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2362:x1870603507274112:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 1678us (2075us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783946849.643433:0:6950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00002000:00100000:3.0:1783946849.643447:0:6950:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9137be4caa00 x1870603507274112/t4294967305(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:395/0 lens 504/448 e 0 to 0 dl 1783946860 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783946849.643473:0:6950:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be4caa00 with x1870603507274112 ext(0->12) 00010000:00010000:3.0:1783946849.643484:0:6950:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 9 pid: 6942 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.643500:0:6950:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 9 pid: 6942 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783946849.643509:0:6950:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9137be4caa00 00000100:00100000:1.0:1783946849.645869:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.646279:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507274240 00000100:00100000:2.0:1783946849.646292:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507274240 00010000:00010000:2.0:1783946849.646350:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 9 pid: 6942 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946849.646405:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:2.0:1783946849.646419:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3530450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2362:x1870603507274240:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946849.646442:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783946849.646469:0:5942:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783946849.646472:0:5942:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783946849 00002000:00010000:2.0:1783946849.646475:0:5942:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783946849 00002000:00010000:2.0:1783946849.646477:0:5942:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783946849 00002000:00010000:2.0:1783946849.646479:0:5942:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783946849.646487:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 9 pid: 6942 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.646530:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 9 pid: 6942 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.646563:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009566452e/0x229d2ec450db7c87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57209e expref: 9 pid: 6942 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.646587:0:5942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783946849.646592:0:5942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783946849.646598:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.646609:0:5942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.646773:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946849.646861:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3530450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507274240:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 444us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946849.646870:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00010000:00010000:0.0:1783946849.648283:0:6945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.648306:0:6945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.648342:0:6945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.648350:0:6945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.648388:0:6945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.648394:0:6945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946849.648398:0:6945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.648404:0:6945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.648507:0:6945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.648513:0:6945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db7cd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946849.648609:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507273984:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 11934us (12247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946849.648620:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:1.0:1783946849.658560:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.659513:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507274496 00000100:00100000:2.0:1783946849.659531:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507274496 00000100:00100000:2.0:1783946849.659618:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:2.0:1783946849.659632:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a07e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+25:11318:x1870603507274496:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:2.0:1783946849.659731:0:5959:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720ba expref: 25 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783946849.660151:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1783946849.660188:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1783946849.660780:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1783946849.660829:0:5959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.662317:0:5959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572090 expref: 29 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.662333:0:5959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.662407:0:5959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572090 expref: 29 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.662429:0:5959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572090 expref: 29 pid: 5957 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946849.662450:0:5959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5959:1870603523009920:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946849.663183:0:5959:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783946849.671528:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946849.671619:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507274624 00000100:00100000:3.0:1783946849.671631:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507274624 00010000:00010000:3.0:1783946849.671691:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572090 expref: 30 pid: 5957 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946849.671691:0:5959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5959:1870603523009920:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946849.671724:0:5959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946849.671743:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:3.0:1783946849.671754:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+30:2361:x1870603507274624:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946849.671774:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946849.671790:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572090 expref: 30 pid: 5957 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.671801:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572090 expref: 30 pid: 5957 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.671826:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7c72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572090 expref: 30 pid: 5957 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.671853:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be239300) 00010000:00010000:3.0:1783946849.671880:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.672148:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.672157:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.672190:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783946849.672220:0:5959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.672238:0:5959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946849.672363:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:2361:x1870603507274624:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 609us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946849.672373:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00000001:00080000:0.0:1783946849.672411:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1783946849.672638:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1783946849.672768:0:5959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5959:1870603523010048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783946849.672842:0:5959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946849.672931:0:5959:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ad7900 going to sleep for 11 seconds 00000100:00100000:1.0:1783946849.674120:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523010048 00000100:00100000:1.0:1783946849.674137:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523010048 00000100:00100000:1.0:1783946849.674276:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783946849.674289:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5959:x1870603523010048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783946849.674647:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5959:x1870603523010048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 360us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946849.674656:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1783946849.674712:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783946849.674779:0:5959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5959:1870603523010048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783946849.675127:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1783946849.675237:0:5959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5959:1870603523010176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783946849.675294:0:5959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946849.675326:0:5959:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028780 going to sleep for 11 seconds 00000100:00100000:3.0:1783946849.678621:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523010176 00000100:00100000:3.0:1783946849.678641:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523010176 00000100:00100000:3.0:1783946849.678736:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783946849.678748:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5959:x1870603523010176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783946849.679035:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5959:x1870603523010176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 287us (3738us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783946849.679044:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783946849.679647:0:5959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5959:1870603523010176:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783946849.679754:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1783946849.679820:0:5959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.679833:0:5959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.679843:0:5959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.679850:0:5959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946849.679856:0:5959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.679864:0:5959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.679884:0:5959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be239300) 00010000:00010000:2.0:1783946849.679887:0:5959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783946849.679894:0:5959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.679901:0:5959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cdb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783946849.680051:0:5959:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783946849.680170:0:5959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1783946849.680325:0:5959:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 453599263919ns, next at 454599261161ns, rc = 0 00000001:00080000:2.0:1783946849.680334:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1783946849.680363:0:5959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be239300) 00010000:00010000:2.0:1783946849.680383:0:5959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783946849.680392:0:5959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7cc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720ba expref: 33 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946849.680535:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a07e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+32:11318:x1870603507274496:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 20904us (21985us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1783946849.680546:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000020:00080000:2.0:1783946849.680553:0:5959:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783946849.685803:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946849.685910:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507274752 00000100:00100000:3.0:1783946849.685924:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507274752 00000100:00100000:3.0:1783946849.686020:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 151 00000100:00100000:3.0:1783946849.686033:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+32:11318:x1870603507274752:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946849.686174:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946849.686328:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7ce2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720c1 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.686429:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7ce2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720c1 expref: 33 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.686475:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7ce2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720c1 expref: 33 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.686502:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946849.686507:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783946849.686513:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031800, rc 0) 00000100:00100000:3.0:1783946849.686731:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:11318:x1870603507274752:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 699us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946849.686741:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 151 00000100:00100000:3.0:1783946849.695577:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946849.695914:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507275008 00000100:00100000:1.0:1783946849.695931:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507275008 00000100:00100000:1.0:1783946849.696014:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:1.0:1783946849.696027:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:11318:x1870603507275008:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1783946849.696433:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+34:11318:x1870603507275008:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 407us (870us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1783946849.696443:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:1.0:1783946849.782655:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946849.782846:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507275264 00000100:00100000:0.0:1783946849.782870:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507275264 00000100:00100000:0.0:1783946849.782968:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 152 00000100:00100000:0.0:1783946849.782982:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+34:11328:x1870603507275264:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946849.783017:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946849.783047:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7ce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720c8 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946849.783253:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783946849.783410:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7ce9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720c8 expref: 36 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.783431:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be239100) 00010000:00010000:0.0:1783946849.783434:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783946849.783441:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7ce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720c8 expref: 36 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946849.783460:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9000, rc 0) 00000100:00100000:0.0:1783946849.784136:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:11328:x1870603507275264:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1150us (1505us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1783946849.784147:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 152 00000100:00100000:3.0:1783946849.787012:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.787583:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507275392 00000100:00100000:2.0:1783946849.787598:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507275392 00000100:00100000:2.0:1783946849.787792:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 153 00000100:00100000:2.0:1783946849.787807:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:11328:x1870603507275392:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1783946849.787945:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.787968:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.787982:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788003:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788011:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788019:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788205:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788214:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788221:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946849.788286:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788302:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788309:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788317:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788325:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946849.788330:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788339:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788354:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946849.788357:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946849.788363:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788377:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7cf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788394:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788400:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788406:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788411:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946849.788414:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788421:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788428:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137894a1f00) 00010000:00010000:2.0:1783946849.788431:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946849.788434:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788439:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7cfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788455:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788461:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788474:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788480:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946849.788482:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788488:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788496:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946849.788499:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946849.788515:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.788522:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946849.788630:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:11328:x1870603507275392:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 825us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946849.789248:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 153 00000100:00100000:0.0:1783946849.791595:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946849.791838:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507275648 00000100:00100000:1.0:1783946849.791852:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507275648 00000100:00100000:1.0:1783946849.792266:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:1.0:1783946849.792281:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:11328:x1870603507275648:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1783946849.792616:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:11328:x1870603507275648:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 337us (1118us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1783946849.792625:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:1.0:1783946849.842214:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.842366:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507275904 00000100:00100000:2.0:1783946849.842380:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507275904 00000100:00100000:2.0:1783946849.842463:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 154 00000100:00100000:2.0:1783946849.842479:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:11331:x1870603507275904:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946849.842519:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946849.842555:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720cf expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843055:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843129:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843146:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843163:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843168:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843173:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843435:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843442:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843447:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946849.843459:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783946849.843572:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843579:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843596:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843601:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946849.843605:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843610:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843623:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946849.843625:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946849.843628:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843633:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843701:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843705:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843708:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843711:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946849.843713:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843724:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843730:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137894a1f00) 00010000:00010000:2.0:1783946849.843732:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946849.843734:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843738:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843788:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720cf expref: 39 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843803:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720cf expref: 38 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946849.843811:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946849.843814:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946849.843817:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8200, rc 0) 00000100:00100000:2.0:1783946849.844441:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+38:11331:x1870603507275904:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1499us (1785us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1783946849.844450:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 154 00000100:00100000:2.0:1783946849.850913:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946849.851056:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507276032 00000100:00100000:3.0:1783946849.851087:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507276032 00000100:00100000:3.0:1783946849.851145:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 155 00000100:00100000:3.0:1783946849.851153:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+38:11331:x1870603507276032:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1783946849.851272:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.851292:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.851303:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.851348:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.851353:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.851376:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.851381:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946849.851385:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.851391:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.851403:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946849.851406:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783946849.851410:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946849.851414:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946849.851515:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+38:11331:x1870603507276032:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 361us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946849.851524:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 155 00000100:00100000:0.0:1783946849.856112:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946849.857857:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507276288 00000100:00100000:2.0:1783946849.857884:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507276288 00000100:00100000:2.0:1783946849.858117:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:2.0:1783946849.858135:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+38:11331:x1870603507276288:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946849.859573:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+39:11331:x1870603507276288:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 1429us (3517us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1783946849.859588:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:1.0:1783946850.170718:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946850.170884:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507276544 00000100:00100000:0.0:1783946850.170898:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507276544 00000100:00100000:0.0:1783946850.170986:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 156 00000100:00100000:0.0:1783946850.171000:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+39:11362:x1870603507276544:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:0.0:1783946850.171033:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946850.171102:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db7d36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720d6 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.171300:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7d3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.171319:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7d3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.171337:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7d3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946850.171352:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783946850.171496:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9400/0x229d2ec450db7d36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720d6 expref: 42 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.171520:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7d3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720d6 expref: 41 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.171553:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:0.0:1783946850.171556:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946850.171561:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9000, rc 0) 00000100:00100000:0.0:1783946850.171779:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:11362:x1870603507276544:12345-192.168.201.18@tcp:101:cat.0 Request processed in 780us (1072us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1783946850.171788:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 156 00000100:00100000:3.0:1783946850.176828:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946850.177638:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507276800 00000100:00100000:1.0:1783946850.177661:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507276800 00000100:00100000:1.0:1783946850.177749:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:1.0:1783946850.177762:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:11362:x1870603507276800:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:1.0:1783946850.178201:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:11362:x1870603507276800:12345-192.168.201.18@tcp:35:cat.0 Request processed in 440us (1386us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1783946850.178211:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:0.0:1783946850.180324:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946850.180440:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507276928 00000100:00100000:3.0:1783946850.180454:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507276928 00000100:00100000:3.0:1783946850.180602:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1783946850.180614:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:2361:x1870603507276928:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946850.180634:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946850.180670:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7d3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720d6 expref: 42 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.180719:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946850.180725:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946850.180845:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:2361:x1870603507276928:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 232us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946850.180855:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:2.0:1783946850.193215:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be4cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523010304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946850.193323:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946850.193498:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523010304 00000100:00100000:1.0:1783946850.193510:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523010304 00000100:00100000:1.0:1783946850.193595:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783946850.193607:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523010304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946850.193648:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00080000:3.0:1783946850.193773:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946850.194447:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523010304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 838us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946850.194458:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783946850.194582:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be4cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523010304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946850.241232:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946850.241647:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507277184 00000100:00100000:3.0:1783946850.241663:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507277184 00000100:00100000:3.0:1783946850.241754:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 157 00000100:00100000:3.0:1783946850.241767:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:11368:x1870603507277184:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:3.0:1783946850.241805:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946850.241809:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783946850.241847:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7ca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720ac expref: 41 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.241959:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:3.0:1783946850.241966:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946850.241987:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7d4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720dd expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.242196:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.242402:0:7190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720cf expref: 41 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.242439:0:7190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.242489:0:7190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720cf expref: 41 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.242505:0:7190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720cf expref: 41 pid: 5958 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946850.242523:0:7190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523010432:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946850.242665:0:7190:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be84e600 going to sleep for 11 seconds 00000100:00100000:0.0:1783946850.246510:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946850.246649:0:7190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523010432:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946850.246689:0:7190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946850.246799:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507277312 00000100:00100000:2.0:1783946850.246809:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507277312 00010000:00010000:2.0:1783946850.247009:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720cf expref: 42 pid: 5958 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946850.247101:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:2.0:1783946850.247113:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:2361:x1870603507277312:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946850.247135:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946850.247144:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720cf expref: 42 pid: 5958 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.247158:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720cf expref: 42 pid: 5958 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.247203:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720cf expref: 42 pid: 5958 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.247228:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946850.247234:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.247267:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.247276:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.247310:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946850.247383:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:2361:x1870603507277312:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 271us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946850.247393:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00010000:00010000:3.0:1783946850.247451:0:7190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.247459:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946850.247485:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783946850.247691:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7d4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720dd expref: 42 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.247713:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720dd expref: 41 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.247736:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946850.247740:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783946850.247742:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030600, rc 0) 00000100:00100000:3.0:1783946850.247774:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:11368:x1870603507277184:12345-192.168.201.18@tcp:101:dd.0 Request processed in 6010us (6565us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1783946850.247782:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 157 00000100:00100000:0.0:1783946850.250420:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946850.250709:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507277440 00000100:00100000:2.0:1783946850.250723:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507277440 00000100:00100000:2.0:1783946850.250840:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 158 00000100:00100000:2.0:1783946850.250853:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:11368:x1870603507277440:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:2.0:1783946850.250911:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946850.250943:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720e4 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.250991:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.251009:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.251024:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.251231:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720e4 expref: 43 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.251268:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720e4 expref: 42 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.251278:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946850.251281:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783946850.251285:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9000, rc 0) 00000100:00100000:2.0:1783946850.251370:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:11368:x1870603507277440:12345-192.168.201.18@tcp:101:dd.0 Request processed in 519us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946850.251378:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 158 00000100:00100000:0.0:1783946850.260433:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946850.260586:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507277696 00000100:00100000:2.0:1783946850.260601:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507277696 00000100:00100000:2.0:1783946850.260683:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 159 00000100:00100000:2.0:1783946850.260697:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:11368:x1870603507277696:12345-192.168.201.18@tcp:36:dd.0 00010000:00010000:2.0:1783946850.261665:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.261697:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.261711:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783946850.261780:0:5956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1783946850.261814:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054e28ffe reply state 00000000a366e28f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946850.262144:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783946850.262450:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+45:11368:x1870603507277696:12345-192.168.201.18@tcp:36:dd.0 Request processed in 1750us (2029us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1783946850.262461:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 159 00000020:00080000:2.0:1783946850.262469:0:5956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783946850.280015:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.280042:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.280051:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.280298:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946850.280306:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.280316:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.280342:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:0.0:1783946850.280371:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946850.280378:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.280385:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7d6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946850.556650:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946850.556994:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507277824 00000100:00100000:2.0:1783946850.557006:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507277824 00000100:00100000:2.0:1783946850.557109:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 160 00000100:00100000:2.0:1783946850.557119:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+44:11382:x1870603507277824:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:2.0:1783946850.557150:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946850.557173:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720eb expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.557620:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.557643:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.557658:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.557677:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.557684:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.557691:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.558112:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.558142:0:5957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720dd expref: 45 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.558151:0:5957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.558272:0:5957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720dd expref: 45 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.558293:0:5957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720dd expref: 45 pid: 7190 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946850.558311:0:5957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137a3501180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523010560:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946850.558576:0:5957:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028480 going to sleep for 11 seconds 00000100:00100000:1.0:1783946850.565942:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946850.566128:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507278080 00000100:00100000:3.0:1783946850.566140:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507278080 00000100:00100000:2.0:1783946850.566149:0:5957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137a3501180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523010560:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946850.566199:0:5957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946850.566232:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:3.0:1783946850.566244:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+46:5910:x1870603507278080:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783946850.567966:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:5910:x1870603507278080:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 1708us (2025us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1783946850.567981:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1783946850.574797:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946850.574977:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507278208 00000100:00100000:2.0:1783946850.574991:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507278208 00010000:00010000:2.0:1783946850.575089:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720dd expref: 47 pid: 7190 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946850.575142:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:2.0:1783946850.575154:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:2361:x1870603507278208:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946850.575176:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946850.575222:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720dd expref: 47 pid: 7190 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.575244:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720dd expref: 47 pid: 7190 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.575274:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7d52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720dd expref: 47 pid: 7190 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.575294:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946850.575300:0:5942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.575312:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.575322:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.575358:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946850.575432:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+46:2361:x1870603507278208:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 280us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946850.575440:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00010000:00010000:0.0:1783946850.576713:0:5957:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.576731:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946850.576901:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783946850.576907:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946850.576942:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.576962:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.576973:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.576980:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.576989:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.576996:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946850.577021:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577030:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577044:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:0.0:1783946850.577048:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946850.577053:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577081:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7d7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577100:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577106:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577112:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577117:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946850.577120:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577127:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577135:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137894a1f00) 00010000:00010000:0.0:1783946850.577137:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946850.577146:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577152:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7d83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577859:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720eb expref: 46 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577887:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720eb expref: 45 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.577896:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:0.0:1783946850.577899:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946850.577902:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8400, rc 0) 00000100:00100000:0.0:1783946850.578011:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+45:11382:x1870603507277824:12345-192.168.201.18@tcp:101:stat.0 Request processed in 20890us (21372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946850.578021:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 160 00010000:00010000:1.0:1783946850.578918:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946850.670351:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946850.670716:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507278464 00000100:00100000:3.0:1783946850.670730:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507278464 00000100:00100000:3.0:1783946850.670946:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00100000:3.0:1783946850.670960:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+45:11388:x1870603507278464:12345-192.168.201.18@tcp:36:truncate.0 00010000:00010000:0.0:1783946850.676490:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946850.676548:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720eb expref: 45 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.676581:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:0.0:1783946850.676588:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783946850.678422:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.678456:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946850.678497:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783946850.678562:0:7190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1783946850.678592:0:7190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009de5fb5d reply state 000000005b2fa9b6 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946850.678605:0:7190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783946850.678966:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:11388:x1870603507278464:12345-192.168.201.18@tcp:36:truncate.0 Request processed in 8002us (8625us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1783946850.679967:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 161 00000020:00080000:0.0:1783946850.680155:0:7190:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783946850.687133:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.687158:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.687167:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.687210:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946850.687217:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.687226:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.687250:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946850.687254:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946850.687260:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946850.687267:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7d91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946850.872957:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946850.881435:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507278592 00000100:00100000:2.0:1783946850.881461:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507278592 00000100:00100000:2.0:1783946850.881577:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 162 00000100:00100000:2.0:1783946850.881589:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+46:11402:x1870603507278592:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:2.0:1783946850.881625:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946850.881657:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720f2 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.881773:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.881792:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.881807:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.881825:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.881832:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.881838:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.881932:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.881940:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.881947:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946850.882001:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1783946850.882006:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783946850.882035:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882086:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882097:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882104:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882112:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882119:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946850.882123:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882132:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882145:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946850.882148:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946850.882153:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882159:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db7d9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882186:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882193:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882205:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882210:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946850.882213:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882218:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882226:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137894a1200) 00010000:00010000:2.0:1783946850.882228:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946850.882231:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882236:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db7da6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882271:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db7d98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f2 expref: 48 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882284:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f2 expref: 47 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946850.882291:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946850.882293:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946850.882296:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8600, rc 0) 00000100:00100000:2.0:1783946850.882389:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:11402:x1870603507278592:12345-192.168.201.18@tcp:101:stat.0 Request processed in 802us (9450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946850.882406:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 162 00000100:00100000:2.0:1783946851.039669:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946851.039792:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507278848 00000100:00100000:0.0:1783946851.039806:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507278848 00000100:00100000:0.0:1783946851.039912:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:0.0:1783946851.039927:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+47:11412:x1870603507278848:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946851.039955:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946851.039982:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7db4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5720f9 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946851.040155:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783946851.040308:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7db4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f9 expref: 49 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.040327:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be239100) 00010000:00010000:0.0:1783946851.040331:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783946851.040356:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7db4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f9 expref: 49 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.040376:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9c00, rc 0) 00000100:00100000:0.0:1783946851.040462:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+48:11412:x1870603507278848:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 540us (808us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1783946851.040471:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00080000:3.0:1783946851.041455:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946851.047759:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946851.047878:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507279104 00000100:00100000:3.0:1783946851.047891:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507279104 00000100:00100000:3.0:1783946851.047967:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:3.0:1783946851.047979:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a07e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+48:11412:x1870603507279104:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1783946851.048353:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a07e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:11412:x1870603507279104:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 375us (609us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1783946851.048364:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:2.0:1783946851.133973:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946851.134144:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507279360 00000100:00100000:0.0:1783946851.134157:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507279360 00000100:00100000:0.0:1783946851.134248:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:0.0:1783946851.134262:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+49:11418:x1870603507279360:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946851.134299:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946851.134332:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7dc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572100 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.134514:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.134534:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f2 expref: 50 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.134544:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.134587:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f2 expref: 50 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.134603:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f2 expref: 50 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946851.134632:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523010688:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946851.135136:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ad7480 going to sleep for 11 seconds 00000100:00100000:2.0:1783946851.144466:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946851.144626:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523010688:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946851.144667:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946851.145126:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507279488 00000100:00100000:3.0:1783946851.145138:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507279488 00010000:00010000:3.0:1783946851.145216:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f2 expref: 51 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946851.145266:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:3.0:1783946851.145300:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+51:2361:x1870603507279488:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946851.145321:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946851.145329:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f2 expref: 51 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.145344:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f2 expref: 51 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.145376:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7dad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720f2 expref: 51 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.145396:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946851.145401:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.145413:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.145423:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.145564:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946851.145641:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:2361:x1870603507279488:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 343us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946851.145650:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00010000:00010000:0.0:1783946851.149963:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.149986:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946851.150019:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1783946851.150692:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7dc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572100 expref: 51 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.150725:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572100 expref: 50 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.150737:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:0.0:1783946851.150741:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783946851.150745:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9600, rc 0) 00000100:00100000:0.0:1783946851.151629:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:11418:x1870603507279360:12345-192.168.201.18@tcp:101:bash.0 Request processed in 17363us (17664us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1783946851.151642:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:2.0:1783946851.160461:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946851.160584:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507279744 00000100:00100000:0.0:1783946851.160619:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507279744 00000100:00100000:0.0:1783946851.160923:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:0.0:1783946851.160937:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:11418:x1870603507279744:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:0.0:1783946851.161414:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.161437:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.161453:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783946851.161505:0:5956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1783946851.161528:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000037ba69f9 reply state 0000000069132ac7 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946851.161540:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783946851.161945:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+53:11418:x1870603507279744:12345-192.168.201.18@tcp:36:bash.0 Request processed in 1007us (1497us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1783946851.161954:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 165 00000020:00080000:0.0:1783946851.161961:0:5956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783946851.168684:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.168709:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.168719:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.168726:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946851.168732:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.168740:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.168764:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946851.168767:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946851.168773:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.168780:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db7dd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946851.170804:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946851.170983:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507279872 00000100:00100000:0.0:1783946851.170998:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507279872 00000100:00100000:0.0:1783946851.171118:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:0.0:1783946851.171131:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:11418:x1870603507279872:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946851.171162:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946851.171209:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7dde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572107 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.171332:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.171370:0:5957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572100 expref: 53 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.171381:0:5957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.171424:0:5957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572100 expref: 53 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.171439:0:5957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572100 expref: 53 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946851.171457:0:5957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523010816:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946851.171583:0:5957:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ad7480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946851.174141:0:5957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523010816:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946851.174217:0:5957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946851.183412:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946851.183596:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507280000 00000100:00100000:0.0:1783946851.183610:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507280000 00010000:00010000:0.0:1783946851.183665:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572100 expref: 54 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946851.183723:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:0.0:1783946851.183734:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:2362:x1870603507280000:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946851.183765:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946851.183780:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572100 expref: 54 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.183796:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572100 expref: 54 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.183825:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db7dc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572100 expref: 54 pid: 5958 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.183847:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:0.0:1783946851.183852:0:5942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.183865:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.183873:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946851.183913:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946851.183993:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+53:2362:x1870603507280000:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 259us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946851.184001:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00010000:00010000:2.0:1783946851.184513:0:5957:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.184525:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946851.184596:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783946851.184602:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783946851.184628:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.184669:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7dde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572107 expref: 53 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.184689:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572107 expref: 52 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.184697:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946851.184700:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946851.184703:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8e00, rc 0) 00000100:00100000:2.0:1783946851.184882:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:11418:x1870603507279872:12345-192.168.201.18@tcp:101:bash.0 Request processed in 13752us (14091us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946851.184892:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:2.0:1783946851.194717:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946851.194817:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507280256 00000100:00100000:3.0:1783946851.194830:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507280256 00000100:00100000:3.0:1783946851.194912:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:3.0:1783946851.194924:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:11418:x1870603507280256:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:3.0:1783946851.195325:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+53:11418:x1870603507280256:12345-192.168.201.18@tcp:35:bash.0 Request processed in 401us (618us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1783946851.195335:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000004:00080000:2.0:1783946851.218838:0:8317:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 455137774205ns, next at 456137769660ns, rc = 0 00000100:00100000:0.0:1783946851.218883:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523010944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946851.218989:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946851.219359:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523010944 00000100:00100000:3.0:1783946851.219371:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523010944 00000100:00100000:3.0:1783946851.219443:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783946851.219455:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1870603523010944:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783946851.219460:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1783946851.219494:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33972800 pending 28672 free 3923664896 avail 3692142592 00000100:00100000:3.0:1783946851.219566:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1870603523010944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946851.219575:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783946851.219775:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523010944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946851.220361:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523011456:0@lo:400:kworker.0 00000100:00100000:1.0:1783946851.220408:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946851.220408:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523011328:0@lo:400:kworker.0 00000100:00100000:0.0:1783946851.220443:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946851.220445:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783946851.220450:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523011072:0@lo:400:kworker.0 00000100:00100000:0.0:1783946851.220469:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783946851.220474:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523011200:0@lo:400:kworker.0 00000100:00100000:1.0:1783946851.220484:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946851.220503:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523011584:0@lo:400:kworker.0 00000100:00100000:0.0:1783946851.220518:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946851.220545:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523011328 00000100:00100000:1.0:1783946851.220551:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523011328 00000100:00100000:0.0:1783946851.220551:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523011200 00000100:00100000:0.0:1783946851.220554:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523011200 00000100:00100000:1.0:1783946851.220600:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783946851.220697:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523011072 00000100:00100000:3.0:1783946851.220701:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523011072 00000100:00100000:3.0:1783946851.220732:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1783946851.220739:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523011072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946851.220783:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523011072:12345-0@lo:400:kworker.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946851.220790:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:2.0:1783946851.221243:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946851.226305:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783946851.226326:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523011200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946851.226483:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523011200:12345-0@lo:400:kworker.0 Request processed in 162us (5962us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946851.226491:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783946851.226559:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523011200:0@lo:400:kworker.0 00000100:00100000:0.0:1783946851.226633:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523011456 00000100:00100000:0.0:1783946851.226642:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523011456 00000100:00100000:1.0:1783946851.226695:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603523011328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946851.226699:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783946851.226706:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523011456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946851.226740:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523011456:12345-0@lo:400:kworker.0 Request processed in 35us (6331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946851.226744:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603523011328:12345-0@lo:400:kworker.0 Request processed in 6137us (6301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946851.226747:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783946851.226751:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783946851.226782:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946851.226840:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523011456:0@lo:400:kworker.0 00000100:00100000:1.0:1783946851.226864:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523011072:0@lo:400:kworker.0 00000100:00100000:1.0:1783946851.226899:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523011328:0@lo:400:kworker.0 00000100:00100000:3.0:1783946851.227527:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523011584 00000100:00100000:3.0:1783946851.227536:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523011584 00000100:00100000:3.0:1783946851.227609:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783946851.227619:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523011584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946851.227676:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523011584:12345-0@lo:400:kworker.0 Request processed in 59us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946851.227684:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783946851.227798:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523011584:0@lo:400:kworker.0 00000100:00080000:2.0:1783946851.228819:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946851.305593:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946851.305741:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507280512 00000100:00100000:2.0:1783946851.305757:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507280512 00000100:00100000:2.0:1783946851.305843:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:2.0:1783946851.305867:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+53:11428:x1870603507280512:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946851.305903:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946851.305937:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db7dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57210e expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946851.306135:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783946851.306295:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db7dec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57210e expref: 55 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.306314:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be239100) 00010000:00010000:2.0:1783946851.306318:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946851.306323:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db7dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57210e expref: 55 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.306342:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9c00, rc 0) 00000100:00100000:2.0:1783946851.306425:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:11428:x1870603507280512:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 571us (848us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1783946851.306433:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:2.0:1783946851.318965:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946851.319087:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507280640 00000100:00100000:3.0:1783946851.319119:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507280640 00000100:00100000:3.0:1783946851.319275:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:3.0:1783946851.319290:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:11428:x1870603507280640:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:3.0:1783946851.319881:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.319904:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.319922:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.319943:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.319951:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.319957:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.320102:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.320113:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.320121:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783946851.320985:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.321035:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.321043:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.321052:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322039:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946851.322052:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322090:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322109:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:3.0:1783946851.322112:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946851.322119:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322126:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322148:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322156:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322163:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322617:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946851.322622:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322633:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322651:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137983e1100) 00010000:00010000:3.0:1783946851.322654:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946851.322658:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322666:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322692:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322698:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322704:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322709:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946851.322711:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322717:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322740:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946851.322742:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946851.322937:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.322947:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946851.323244:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:11428:x1870603507280640:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 3949us (4285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946851.323257:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:1.0:1783946851.333568:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946851.337306:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507280896 00000100:00100000:0.0:1783946851.337329:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507280896 00000100:00100000:0.0:1783946851.337496:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:0.0:1783946851.337510:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:11428:x1870603507280896:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1783946851.338155:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:11428:x1870603507280896:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 643us (4598us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1783946851.338177:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:1.0:1783946851.376014:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946851.380623:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507281152 00000100:00100000:2.0:1783946851.381354:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507281152 00000100:00100000:2.0:1783946851.381534:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:2.0:1783946851.381549:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:11431:x1870603507281152:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946851.381583:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946851.381636:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7e0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572115 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.382029:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.382048:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.382478:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.382503:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.382513:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.382520:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.383518:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7e24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.383538:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.383549:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946851.383563:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783946851.384518:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384559:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384567:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384575:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946851.384581:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384589:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384606:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946851.384608:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946851.384613:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384620:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7e16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384637:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384654:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384660:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384665:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946851.384673:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384679:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384687:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137894a1200) 00010000:00010000:2.0:1783946851.384689:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946851.384692:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.384698:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.385531:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7e0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572115 expref: 58 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.385559:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7e24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572115 expref: 57 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946851.385568:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946851.385570:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946851.385574:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9e00, rc 0) 00000100:00100000:2.0:1783946851.385694:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:11431:x1870603507281152:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 4147us (9694us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1783946851.385704:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:2.0:1783946851.395830:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946851.395888:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946851.395995:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507281280 00000100:00100000:1.0:1783946851.396008:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507281280 00000100:00100000:1.0:1783946851.396124:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:1.0:1783946851.396143:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:11431:x1870603507281280:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:1.0:1783946851.396264:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.396285:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.396299:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.396345:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.396353:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.396361:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.396367:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946851.396373:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.396381:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.397826:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:1.0:1783946851.397838:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783946851.397846:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.397856:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44a00/0x229d2ec450db7e32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946851.397998:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:11431:x1870603507281280:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 1850us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946851.398009:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:3.0:1783946851.402573:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507281408 00000100:00100000:3.0:1783946851.402595:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507281408 00000100:00100000:3.0:1783946851.402705:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1783946851.402719:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3533c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:2362:x1870603507281408:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946851.402746:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946851.402786:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7e24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572115 expref: 57 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.402814:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946851.402821:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946851.402905:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3533c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:2362:x1870603507281408:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 190us (7015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946851.402914:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1783946851.406669:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946851.406774:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507281664 00000100:00100000:1.0:1783946851.406787:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507281664 00000100:00100000:1.0:1783946851.406859:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:1.0:1783946851.406871:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:11431:x1870603507281664:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1783946851.408551:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:11431:x1870603507281664:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 1666us (1880us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1783946851.408568:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00010000:00010000:0.0:1783946851.601470:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946851.625508:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946851.628037:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507281920 00000100:00100000:3.0:1783946851.628075:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507281920 00000100:00100000:3.0:1783946851.628273:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:3.0:1783946851.628312:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+57:11449:x1870603507281920:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1783946851.628351:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946851.628381:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57211c expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.628543:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.628562:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.628576:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946851.628590:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783946851.628729:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57211c expref: 60 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.628753:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57211c expref: 59 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.628763:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946851.628766:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783946851.628770:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030800, rc 0) 00000100:00100000:3.0:1783946851.630150:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:11449:x1870603507281920:12345-192.168.201.18@tcp:101:cat.0 Request processed in 1827us (4643us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1783946851.630173:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:0.0:1783946851.683265:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946851.683567:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507282048 00000100:00100000:3.0:1783946851.683581:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507282048 00000100:00100000:3.0:1783946851.683669:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:3.0:1783946851.683682:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:11450:x1870603507282048:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946851.683717:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946851.683747:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572123 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.683851:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7e55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.683995:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.684010:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946851.684123:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783946851.684128:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946851.684153:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.684338:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572123 expref: 61 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.684364:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7e55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572123 expref: 60 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.684375:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:3.0:1783946851.684378:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946851.684383:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030000, rc 0) 00000100:00100000:3.0:1783946851.684466:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:11450:x1870603507282048:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 786us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946851.684483:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:1.0:1783946851.688872:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946851.692178:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507282432 00000100:00100000:2.0:1783946851.692301:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507282432 00000100:00100000:2.0:1783946851.692485:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:2.0:1783946851.692500:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:11450:x1870603507282432:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946851.692929:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11450:x1870603507282432:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 431us (4081us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1783946851.692938:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:0.0:1783946851.697545:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946851.697726:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507282560 00000100:00100000:3.0:1783946851.697740:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507282560 00000100:00100000:3.0:1783946851.697834:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:3.0:1783946851.697848:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11450:x1870603507282560:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:3.0:1783946851.697871:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783946851.697903:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572107 expref: 61 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.697932:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57211c expref: 60 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.697947:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031800/0x229d2ec450db7ce2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720c1 expref: 59 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.697961:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946851.697967:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946851.698044:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:11450:x1870603507282560:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 199us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946851.698053:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1783946851.700284:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946851.700520:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507282688 00000100:00100000:3.0:1783946851.700531:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507282688 00000100:00100000:3.0:1783946851.700604:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:3.0:1783946851.700617:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:11450:x1870603507282688:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:3.0:1783946851.700769:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.700818:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946851.700834:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783946851.701104:0:7190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1783946851.702133:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:11450:x1870603507282688:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 1505us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946851.702149:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:0.0:1783946851.740467:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946851.740718:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507282816 00000100:00100000:1.0:1783946851.740733:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507282816 00000100:00100000:1.0:1783946851.740820:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 174 00000100:00100000:1.0:1783946851.740834:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:11452:x1870603507282816:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1783946851.740878:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946851.740910:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7e63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57212a expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741009:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741027:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741040:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741123:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741131:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741139:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741526:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741538:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741547:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946851.741601:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783946851.741606:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783946851.741630:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741644:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741654:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741662:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741681:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741688:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946851.741693:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741702:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741717:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:1.0:1783946851.741721:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946851.741726:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741734:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db7e6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741750:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741757:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741763:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741768:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946851.741771:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741787:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741797:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137979fe600) 00010000:00010000:1.0:1783946851.741799:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946851.741802:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741809:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7e71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741849:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7e63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57212a expref: 60 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741946:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57212a expref: 59 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946851.741956:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:1.0:1783946851.741958:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783946851.741961:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44000, rc 0) 00000100:00100000:1.0:1783946851.742048:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:11452:x1870603507282816:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1217us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946851.742157:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 174 00000040:00080000:1.0:1783946852.496323:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783946852.496334:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783946852.496372:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1783946852.496381:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783946852.496541:0:12087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be846680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523011712:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783946852.496671:0:12087:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780000 going to sleep for 11 seconds 00000100:00100000:1.0:1783946852.508479:0:12087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be846680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523011712:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783946852.509443:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.510236:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507282944 00000100:00100000:3.0:1783946852.510245:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507282944 00000100:00100000:2.0:1783946852.510376:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 175 00000100:00100000:2.0:1783946852.510387:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:11463:x1870603507282944:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783946852.510431:0:5957:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783946852.510554:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:11463:x1870603507282944:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 167us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946852.510561:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 175 00000001:00080000:2.0:1783946852.511828:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1783946852.511845:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1783946852.511885:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783946852.511894:0:5935:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff913798028b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783946852.511899:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137a7e73e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9137980286c0 00000020:00080000:2.0:1783946852.511902:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137a7e73800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9137be1d6e00 00000100:00100000:2.0:1783946852.512155:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783946852.512178:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523011840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783946852.512239:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783946852.512435:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1783946852.512494:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1783946852.512763:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523011840 00000100:00100000:3.0:1783946852.512770:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523011840 00000100:00100000:3.0:1783946852.512818:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783946852.512827:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3450:x1870603523011840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783946852.512852:0:9002:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1783946852.512882:0:9002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a54de61, atime: 0x6a54de61, ctime: 0x6a54de61, blocks: 0x8 00010000:00010000:3.0:1783946852.512891:0:9002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.512907:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=456s v=(0 0) 00010000:00010000:3.0:1783946852.512911:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946852.512917:0:9002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.512932:0:9002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.512960:0:9002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.512968:0:9002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.512993:0:9002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783946852.513143:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3450:x1870603523011840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 317us (903us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783946852.513162:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1783946852.513313:0:3450:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be6fed80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1783946852.513319:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523011840:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783946852.513439:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946852.513447:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.513457:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946852.513461:0:5944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.513470:0:5944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.513489:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.513496:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48277d0/0x229d2ec450db7e7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.513517:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946852.513519:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946852.513521:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946852.516515:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.516700:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507283072 00000100:00100000:3.0:1783946852.516710:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507283072 00000100:00100000:3.0:1783946852.516766:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 176 00000100:00100000:3.0:1783946852.516776:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:11463:x1870603507283072:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783946852.516846:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.516862:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.516875:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.516892:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.516900:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.516920:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.516948:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.516957:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.516963:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946852.517008:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783946852.517012:0:5958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946852.517024:0:5958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517035:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517042:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517048:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517054:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946852.517096:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517104:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517122:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:3.0:1783946852.517125:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946852.517130:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517136:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7e86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517162:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517170:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517185:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517191:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946852.517194:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517201:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517209:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9137983e1f00) 00010000:00010000:3.0:1783946852.517211:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946852.517214:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517219:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7e8d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517248:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517254:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517261:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517266:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946852.517269:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517275:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517283:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:3.0:1783946852.517286:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946852.517289:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.517294:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7e94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.517694:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:11463:x1870603507283072:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 916us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946852.517703:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 176 00000100:00100000:0.0:1783946852.519909:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.519999:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507283328 00000100:00100000:2.0:1783946852.520009:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507283328 00000100:00100000:2.0:1783946852.520104:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 177 00000100:00100000:2.0:1783946852.520131:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+17:11463:x1870603507283328:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946852.520164:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946852.520555:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572131 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520671:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520686:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520696:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946852.520710:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783946852.520811:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520818:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520825:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520830:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946852.520834:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520842:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520854:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946852.520866:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783946852.520872:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520879:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7ea2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520923:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e9b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572131 expref: 19 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520934:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:2.0:1783946852.520936:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946852.520940:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7e9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572131 expref: 19 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.520949:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9800, rc 0) 00000100:00100000:2.0:1783946852.521091:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11463:x1870603507283328:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 962us (1190us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1783946852.521099:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 177 00000100:00100000:0.0:1783946852.533264:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.534205:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507283456 00000100:00100000:2.0:1783946852.534216:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507283456 00000100:00100000:2.0:1783946852.534289:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 178 00000100:00100000:2.0:1783946852.534313:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11463:x1870603507283456:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783946852.534354:0:5956:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783946852.534722:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11463:x1870603507283456:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 411us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946852.534730:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 178 00000100:00100000:0.0:1783946852.542687:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.542767:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507283712 00000100:00100000:3.0:1783946852.542777:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507283712 00000100:00100000:3.0:1783946852.542840:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 179 00000100:00100000:3.0:1783946852.542857:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11463:x1870603507283712:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946852.542878:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946852.542881:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783946852.542906:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7e55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572123 expref: 18 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.542926:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:3.0:1783946852.542931:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946852.542943:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7eb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572138 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783946852.543595:0:7190:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1783946852.543744:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7eb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.543758:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.543768:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.544051:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7eb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572138 expref: 20 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.544104:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572138 expref: 19 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.544113:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9137983e1f00) 00010000:00010000:3.0:1783946852.544116:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783946852.544127:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030200, rc 0) 00000100:00100000:3.0:1783946852.544194:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11463:x1870603507283712:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1338us (1517us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1783946852.544202:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 179 00000100:00100000:0.0:1783946852.556310:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.556503:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507283968 00000100:00100000:3.0:1783946852.556514:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507283968 00000100:00100000:3.0:1783946852.556574:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 180 00000100:00100000:3.0:1783946852.556584:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11463:x1870603507283968:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783946852.556644:0:5958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946852.556673:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7eb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572138 expref: 19 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556693:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9137983e1f00) 00010000:00010000:3.0:1783946852.556707:0:5958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946852.556731:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556745:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556755:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556814:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556822:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556828:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556889:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556897:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556903:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556909:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946852.556914:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556922:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556931:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:3.0:1783946852.556934:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946852.556937:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556943:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ec5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556953:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556959:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556965:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556977:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946852.556980:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556986:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.556996:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd71d6930 (ffff9137983e1600) 00010000:00010000:3.0:1783946852.556998:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946852.557001:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.557007:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ecc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd71d6930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.557118:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11463:x1870603507283968:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 534us (828us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783946852.557126:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 180 00000100:00100000:0.0:1783946852.566924:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.571565:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507284096 00000100:00100000:2.0:1783946852.571593:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507284096 00000100:00100000:2.0:1783946852.571665:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 181 00000100:00100000:2.0:1783946852.571677:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11463:x1870603507284096:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946852.571699:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946852.571722:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7ed3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57213f expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.571761:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.571774:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.571786:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.571895:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7ed3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57213f expref: 20 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.571913:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57213f expref: 19 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.571922:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:2.0:1783946852.571926:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783946852.571929:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9a00, rc 0) 00000100:00100000:2.0:1783946852.571999:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11463:x1870603507284096:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 324us (5086us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946852.572007:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 181 00000100:00100000:1.0:1783946852.578266:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946852.578330:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507284352 00000100:00100000:1.0:1783946852.578340:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507284352 00000100:00100000:1.0:1783946852.578400:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 182 00000100:00100000:1.0:1783946852.578524:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11463:x1870603507284352:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783946852.578627:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.578645:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.578657:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783946852.578830:0:5958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1783946852.578840:0:5958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 456497780019ns, next at 457497777632ns, rc = 0 00000004:00010000:1.0:1783946852.578890:0:5958:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7ceac19 reply state 00000000a1451016 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946852.578901:0:5958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783946852.578999:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:11463:x1870603507284352:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 479us (742us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1783946852.579008:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 182 00000100:00100000:1.0:1783946852.583569:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:1.0:1783946852.583638:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.583650:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.583658:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.583664:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946852.583669:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.583685:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.583702:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:1.0:1783946852.583705:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783946852.583710:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.583717:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db7ee1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.584304:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507284480 00000100:00100000:3.0:1783946852.584314:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507284480 00000100:00100000:3.0:1783946852.584371:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 183 00000100:00100000:3.0:1783946852.584381:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:11463:x1870603507284480:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946852.584414:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946852.584432:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572146 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.584488:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572146 expref: 21 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.584515:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572146 expref: 21 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.584536:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:3.0:1783946852.584539:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783946852.584541:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030800, rc 0) 00000100:00100000:3.0:1783946852.584597:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:11463:x1870603507284480:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 216us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946852.584605:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 183 00000100:00100000:1.0:1783946852.606023:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.606153:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507284608 00000100:00100000:3.0:1783946852.606165:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507284608 00000100:00100000:3.0:1783946852.606242:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:3.0:1783946852.606254:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507284608:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783946852.606817:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507284608:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 563us (805us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783946852.606825:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00080000:1.0:1783946852.606884:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946852.609762:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.616505:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507284864 00000100:00100000:3.0:1783946852.616522:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507284864 00000100:00100000:3.0:1783946852.616720:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:3.0:1783946852.616732:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:11463:x1870603507284864:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783946852.616975:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:11463:x1870603507284864:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 244us (7222us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1783946852.616985:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00010000:00010000:0.0:1783946852.624877:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946852.627663:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.627774:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507285120 00000100:00100000:3.0:1783946852.627791:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507285120 00000100:00100000:3.0:1783946852.627857:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 184 00000100:00100000:3.0:1783946852.627869:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:11463:x1870603507285120:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783946852.627986:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:11463:x1870603507285120:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 119us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946852.627995:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 184 00000100:00100000:1.0:1783946852.640197:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.642199:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507285248 00000100:00100000:3.0:1783946852.642217:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507285248 00000100:00100000:3.0:1783946852.642304:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 185 00000100:00100000:3.0:1783946852.642321:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:11463:x1870603507285248:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946852.642345:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946852.642370:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7eef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57214d expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.642460:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ef6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.642478:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.642490:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946852.642684:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946852.642710:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.643135:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db7eef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57214d expref: 24 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.643190:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57214d expref: 23 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.643199:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:3.0:1783946852.643203:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783946852.643206:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030000, rc 0) 00000100:00100000:3.0:1783946852.643288:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:11463:x1870603507285248:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 968us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946852.643307:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 185 00000100:00100000:3.0:1783946852.646633:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.647250:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507285376 00000100:00100000:2.0:1783946852.647261:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507285376 00000100:00100000:2.0:1783946852.648425:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1783946852.648446:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507285376:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946852.648471:0:9002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946852.648513:0:9002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572154 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783946852.648541:0:9002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54de64, blocks: 0x0 00010000:00010000:2.0:1783946852.648562:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783946852.648567:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946852.648576:0:9002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572154 expref: 8 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.648595:0:9002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572154 expref: 8 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.648610:0:9002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9800, rc 0) 00000100:00100000:2.0:1783946852.648683:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2361:x1870603507285376:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 246us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946852.648691:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1783946852.658809:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.658894:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507285632 00000100:00100000:3.0:1783946852.658906:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507285632 00000100:00100000:3.0:1783946852.659671:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 186 00000100:00100000:3.0:1783946852.659684:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:11463:x1870603507285632:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783946852.659804:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:11463:x1870603507285632:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 123us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946852.659812:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 186 00000100:00100000:1.0:1783946852.671683:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.671805:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507285760 00000100:00100000:3.0:1783946852.671819:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507285760 00000100:00100000:3.0:1783946852.671906:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:3.0:1783946852.671919:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:11463:x1870603507285760:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946852.671948:0:6944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946852.671979:0:6944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57215b expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.672045:0:6944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572154 expref: 9 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.672088:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946852.672094:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946852.672100:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 9 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.672159:0:6944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572154 expref: 9 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.672592:0:6944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572154 expref: 9 pid: 9002 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.672612:0:6944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6944:1870603523011968:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946852.672777:0:6944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be84e600 going to sleep for 11 seconds 00000100:00100000:2.0:1783946852.677952:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.678622:0:6944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6944:1870603523011968:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946852.678664:0:6944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 9 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.678693:0:6944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030e00, rc 0) 00000100:00100000:3.0:1783946852.678778:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:11463:x1870603507285760:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 6860us (7111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946852.678789:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:0.0:1783946852.679574:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507285888 00000100:00100000:0.0:1783946852.679586:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507285888 00010000:00010000:0.0:1783946852.679635:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572154 expref: 9 pid: 9002 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946852.679679:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:0.0:1783946852.679692:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2362:x1870603507285888:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946852.679712:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946852.679748:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572154 expref: 9 pid: 9002 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.679762:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572154 expref: 9 pid: 9002 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.679808:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db7efd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572154 expref: 9 pid: 9002 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.679826:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946852.679830:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946852.679838:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 8 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.679848:0:5943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 8 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.679916:0:5943:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 8 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946852.679933:0:5943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5943:1870603523012096:192.168.201.18@tcp:105: 00000100:00100000:0.0:1783946852.680037:0:5943:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ad79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946852.691055:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.691114:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507286016 00000100:00100000:3.0:1783946852.691125:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507286016 00002000:00100000:3.0:1783946852.691197:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9137be6ff480 x1870603507286016/t0(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:398/0 lens 504/0 e 0 to 0 dl 1783946863 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783946852.691208:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be6ff480 with x1870603507286016 ext(0->8) 00002000:00010000:3.0:1783946852.691214:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be6ff480 00000100:00100000:3.0:1783946852.691245:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1783946852.691255:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2362:x1870603507286016:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783946852.692674:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:2362:x1870603507286016:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 1413us (1619us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783946852.692685:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00002000:00100000:2.0:1783946852.692705:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9137be6ff480 x1870603507286016/t4294967314(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:398/0 lens 504/448 e 0 to 0 dl 1783946863 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783946852.692715:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be6ff480 with x1870603507286016 ext(0->8) 00002000:00010000:2.0:1783946852.692718:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be6ff480 00000100:00100000:0.0:1783946852.693974:0:5943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5943:1870603523012096:192.168.201.18@tcp:105: 00010000:00010000:0.0:1783946852.694000:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946852.694056:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:2362:x1870603507285888:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 14365us (16117us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946852.694088:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:2.0:1783946852.699462:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946852.701549:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507286144 00000100:00100000:1.0:1783946852.701563:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507286144 00000100:00100000:1.0:1783946852.701637:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 187 00000100:00100000:1.0:1783946852.701649:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:11463:x1870603507286144:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783946852.704419:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1783946852.704435:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1783946852.704459:0:5935:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1783946852.704605:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11463:x1870603507286144:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 2953us (5149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946852.704616:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 187 00000020:00080000:0.0:1783946852.705220:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1783946852.705230:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783946852.705237:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946852.705263:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523012224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783946852.705314:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946852.705360:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523012224 00000100:00100000:0.0:1783946852.705367:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523012224 00000100:00100000:0.0:1783946852.705428:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783946852.705437:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523012224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783946852.705554:0:6945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783946852.705558:0:6945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783946852 00002000:00010000:0.0:1783946852.705560:0:6945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783946852.705562:0:6945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783946852 -> 1783946852 00002000:00010000:0.0:1783946852.705565:0:6945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1783946852.705599:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603523012224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (284us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783946852.705606:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1783946852.705625:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1783946852.705656:0:3449:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be9f0a80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1783946852.705662:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523012224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783946852.716340:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946852.716423:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507286272 00000100:00100000:1.0:1783946852.716433:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507286272 00000100:00100000:1.0:1783946852.716497:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:1.0:1783946852.716508:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:2361:x1870603507286272:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783946852.721334:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1783946852.721350:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1783946852.721544:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507286272:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 5032us (5404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946852.721558:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:3.0:1783946852.725851:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.725936:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507286528 00000100:00100000:2.0:1783946852.725947:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507286528 00000100:00100000:2.0:1783946852.726011:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 188 00000100:00100000:2.0:1783946852.726023:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11463:x1870603507286528:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783946852.726106:0:5956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946852.726136:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db7ef6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57214d expref: 19 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.726285:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:2.0:1783946852.726293:0:5956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946852.726327:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.726341:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.726351:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946852.726581:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001868035a reply state 000000001f7e0dc0 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946852.726607:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783946852.726737:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:11463:x1870603507286528:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 716us (895us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1783946852.726746:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 188 00010000:00010000:0.0:1783946852.739564:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.739582:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.739590:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.739597:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946852.739602:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.739625:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.739642:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:0.0:1783946852.739645:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946852.739650:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.739656:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db7f0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946852.742808:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.742960:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507286656 00000100:00100000:2.0:1783946852.742971:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507286656 00000100:00100000:2.0:1783946852.743043:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:2.0:1783946852.743056:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507286656:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783946852.743570:0:6945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783946852.743576:0:6945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783946852 -> 1783946851 00002000:00010000:2.0:1783946852.743579:0:6945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783946849 00002000:00010000:2.0:1783946852.743581:0:6945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783946852 -> 1783946851 00002000:00010000:2.0:1783946852.743584:0:6945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783946852.743647:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2362:x1870603507286656:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 594us (862us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783946852.743656:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:3.0:1783946852.747225:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946852.747744:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507286912 00000100:00100000:0.0:1783946852.747754:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507286912 00000100:00100000:0.0:1783946852.747823:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 189 00000100:00100000:0.0:1783946852.747836:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11463:x1870603507286912:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783946852.747902:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.747920:0:7190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57213f expref: 19 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.747931:0:7190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.747967:0:7190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57213f expref: 19 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.747981:0:7190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57213f expref: 19 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946852.748011:0:7190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523012352:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946852.748130:0:7190:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ad79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946852.760236:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.760275:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507287040 00000100:00100000:2.0:1783946852.760284:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507287040 00010000:00010000:2.0:1783946852.760623:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57213f expref: 20 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946852.760664:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:2.0:1783946852.760676:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:2361:x1870603507287040:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946852.760697:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946852.760717:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57213f expref: 20 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.760731:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57213f expref: 20 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.760762:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:2.0:1783946852.760768:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.760779:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.760788:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.760811:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946852.760871:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:2361:x1870603507287040:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 197us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946852.760879:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00010000:00010000:3.0:1783946852.761101:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db7eda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57213f expref: 19 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.761117:0:7190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523012352:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946852.761139:0:7190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.761162:0:7190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.761168:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.761221:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.761230:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.761244:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.761250:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946852.761254:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.761262:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.761272:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:3.0:1783946852.761275:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783946852.761279:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.761285:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db7f12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.761565:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11463:x1870603507286912:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 13731us (14346us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783946852.761575:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 189 00000100:00100000:3.0:1783946852.764849:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946852.764933:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507287168 00000100:00100000:0.0:1783946852.764942:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507287168 00000100:00100000:0.0:1783946852.765008:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:0.0:1783946852.765019:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2361:x1870603507287168:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783946852.765108:0:6944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.765133:0:6944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 8 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.765151:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946852.765156:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946852.765162:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.765212:0:6944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 8 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.765228:0:6944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 8 pid: 6944 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946852.765242:0:6944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6944:1870603523012480:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946852.765345:0:6944:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ad7240 going to sleep for 11 seconds 00000100:00100000:3.0:1783946852.774046:0:6944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6944:1870603523012480:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946852.774110:0:6944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.781032:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946852.781280:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507287296 00000100:00100000:0.0:1783946852.781291:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507287296 00010000:00010000:0.0:1783946852.781617:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 9 pid: 6944 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946852.781700:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:0.0:1783946852.781710:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2361:x1870603507287296:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946852.781725:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946852.781746:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 9 pid: 6944 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.781760:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 9 pid: 6944 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.781784:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782c37ea/0x229d2ec450db7f04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57215b expref: 9 pid: 6944 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.781801:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946852.781805:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946852.781812:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.781822:0:8023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.781850:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946852.782271:0:6944:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.782289:0:6944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.782316:0:6944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.782325:0:6944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.782333:0:6944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.782339:0:6944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946852.782344:0:6944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.782353:0:6944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.782366:0:6944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.782373:0:6944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db7f19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.782475:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2361:x1870603507287168:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 17457us (17636us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946852.782485:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:0.0:1783946852.783035:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507287296:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1324us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946852.783043:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:0.0:1783946852.790637:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946852.790693:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507287552 00000100:00100000:0.0:1783946852.790704:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507287552 00000100:00100000:0.0:1783946852.790770:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 190 00000100:00100000:0.0:1783946852.790779:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11463:x1870603507287552:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783946852.790864:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.790881:0:5956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5720e4 expref: 18 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.790892:0:5956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.790930:0:5956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720e4 expref: 18 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946852.790945:0:5956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720e4 expref: 18 pid: 5958 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946852.790960:0:5956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523012608:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946852.791044:0:5956:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ad7240 going to sleep for 11 seconds 00000100:00100000:2.0:1783946852.800022:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.800055:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507287680 00000100:00100000:2.0:1783946852.800088:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507287680 00010000:00010000:2.0:1783946852.800130:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720e4 expref: 19 pid: 5958 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946852.800190:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:2.0:1783946852.800201:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:2361:x1870603507287680:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946852.800216:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946852.800232:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720e4 expref: 19 pid: 5958 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.800247:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720e4 expref: 19 pid: 5958 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.800269:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946852.800275:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.800286:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.800293:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.800579:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946852.800642:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:2361:x1870603507287680:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 442us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946852.800652:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00010000:00010000:3.0:1783946852.801282:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db7d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5720e4 expref: 18 pid: 5958 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.801312:0:5956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523012608:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946852.801338:0:5956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.801347:0:5956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.801352:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.801735:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.801751:0:5956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572146 expref: 18 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.801760:0:5956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.801798:0:5956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572146 expref: 18 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.801841:0:5956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572146 expref: 18 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946852.801856:0:5956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be3f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523012736:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946852.801957:0:5956:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be84e780 going to sleep for 11 seconds 00000100:00100000:0.0:1783946852.831098:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.831448:0:5956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be3f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523012736:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946852.831477:0:5956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946852.833096:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507287808 00000100:00100000:1.0:1783946852.833110:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507287808 00010000:00010000:1.0:1783946852.833188:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572146 expref: 19 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946852.833238:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:1.0:1783946852.833249:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:2362:x1870603507287808:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946852.833269:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946852.833277:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572146 expref: 19 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.833301:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572146 expref: 19 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.833325:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ee8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572146 expref: 19 pid: 5957 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.833343:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:1.0:1783946852.833348:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.833378:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.833386:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.833526:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946852.833589:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2362:x1870603507287808:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 342us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946852.833601:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 74 00010000:00010000:1.0:1783946852.833754:0:5956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.833763:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783946852.833874:0:5956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1783946852.833989:0:5956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1783946852.834027:0:5956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1783946852.834122:0:5956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5956:1870603523012864:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783946852.834191:0:5956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946852.834228:0:5956:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137927809c0 going to sleep for 11 seconds 00000040:00080000:0.0:1783946852.835740:0:12792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783946852.835748:0:12792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783946852.835776:0:12792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1783946852.835781:0:12792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783946852.836371:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523012864 00000100:00100000:3.0:1783946852.836380:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523012864 00000100:00100000:3.0:1783946852.836453:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783946852.836463:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5956:x1870603523012864:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783946852.836582:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5956:x1870603523012864:12345-0@lo:1000:mdt00_000.0 Request processed in 121us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946852.836590:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783946852.836866:0:5956:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1783946852.836873:0:5956:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be9f0a80, transno 4294967315 00000100:00100000:1.0:1783946852.836895:0:5956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5956:1870603523012864:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1783946852.837050:0:5956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1783946852.837163:0:5956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5956:1870603523012992:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783946852.837390:0:5956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946852.843156:0:5956:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783946852.843208:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523012992 00000100:00100000:1.0:1783946852.843218:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523012992 00000100:00100000:1.0:1783946852.843281:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783946852.843460:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5956:x1870603523012992:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783946852.843664:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5956:x1870603523012992:12345-0@lo:1000:mdt00_000.0 Request processed in 374us (6273us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1783946852.843672:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783946852.843732:0:5956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5956:1870603523012992:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783946852.843781:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843791:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843798:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843804:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946852.843808:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843816:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843832:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91379793ef00) 00010000:00010000:1.0:1783946852.843835:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783946852.843839:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843846:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7f27 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843895:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843901:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843907:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843911:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946852.843913:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843918:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843927:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:1.0:1783946852.843929:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783946852.843932:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843938:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7e5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843963:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843978:0:5956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57212a expref: 21 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.843987:0:5956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.844035:0:5956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57212a expref: 21 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.844049:0:5956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57212a expref: 21 pid: 5956 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946852.844091:0:5956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523013120:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783946852.844185:0:5956:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792780d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946852.860092:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946852.860222:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507287936 00000100:00100000:2.0:1783946852.860232:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507287936 00010000:00010000:2.0:1783946852.860269:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57212a expref: 22 pid: 5956 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946852.860304:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:2.0:1783946852.860336:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3533050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:2361:x1870603507287936:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946852.860351:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946852.860359:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57212a expref: 22 pid: 5956 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.860373:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57212a expref: 22 pid: 5956 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.860395:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946852.860410:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.860421:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.860429:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.860447:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946852.860500:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3533050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:2361:x1870603507287936:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 166us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946852.860508:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 75 00010000:00010000:1.0:1783946852.864166:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44000/0x229d2ec450db7e78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57212a expref: 21 pid: 5956 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946852.864238:0:5956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523013120:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783946852.864281:0:5956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866085:0:5956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866101:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866116:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866156:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866163:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866183:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946852.866187:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866196:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866213:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946852.866216:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946852.866221:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866227:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45e00/0x229d2ec450db7f2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866243:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866249:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866255:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866260:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946852.866269:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866275:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866284:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137983e1800) 00010000:00010000:2.0:1783946852.866288:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783946852.866290:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946852.866296:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8600/0x229d2ec450db7f20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946852.866514:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:11463:x1870603507287552:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 75732us (75885us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1783946852.866525:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 190 00000020:00080000:2.0:1783946852.866531:0:5956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783946852.867373:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783946852.867379:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783946852.867964:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1783946852.867973:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783946852.871663:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946852.871732:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507288192 00000100:00100000:3.0:1783946852.871743:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507288192 00000100:00100000:3.0:1783946852.871803:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:3.0:1783946852.871813:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a07e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:11463:x1870603507288192:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783946852.872341:0:5959:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783946852.872378:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1783946852.872487:0:5959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.872505:0:5959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.872517:0:5959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.872543:0:5959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.872550:0:5959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.872556:0:5959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946852.872613:0:5959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783946852.872724:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a07e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:11463:x1870603507288192:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 911us (1065us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1783946852.872733:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000020:00080000:3.0:1783946852.872738:0:5959:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783946852.876808:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946852.876823:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.876836:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946852.876841:0:5944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.876866:0:5944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.876887:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9137983e1600) 00010000:00010000:1.0:1783946852.876890:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783946852.876896:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.876901:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946852.876927:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946852.876929:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946852.876931:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946853.234705:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946853.234746:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946853.234781:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946853.234809:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946853.234832:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946853.234954:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507288832 00000100:00100000:1.0:1783946853.234964:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507288832 00000100:00100000:0.0:1783946853.234965:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507288320 00000100:00100000:0.0:1783946853.234968:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507288320 00000100:00100000:0.0:1783946853.235020:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 305 00000100:00100000:1.0:1783946853.235026:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507288448 00000100:00100000:1.0:1783946853.235029:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507288448 00000100:00100000:0.0:1783946853.235030:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507288320:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946853.235049:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 175 00000100:00100000:1.0:1783946853.235081:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507288832:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946853.235182:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507288576 00000100:00100000:3.0:1783946853.235187:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507288576 00000100:00100000:3.0:1783946853.235217:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507288704 00000100:00100000:3.0:1783946853.235220:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507288704 00000100:00100000:3.0:1783946853.235243:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:3.0:1783946853.235250:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507288576:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946853.235310:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a0798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2364:x1870603507288320:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 281us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946853.235318:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 305 00000100:00100000:0.0:1783946853.235369:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 176 00000100:00100000:0.0:1783946853.235376:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:2364:x1870603507288448:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:2.0:1783946853.235431:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783946853.235436:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946853.235490:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:2.0:1783946853.235500:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507288704:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946853.236286:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5851e04-311c-4929-a2c6-87673cd4c005+5:2364:x1870603507288832:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 1225us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946853.236296:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 175 00000100:00100000:3.0:1783946853.237637:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507288576:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 2378us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946853.237651:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:3.0:1783946853.254043:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:2364:x1870603507288448:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 18652us (19218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946853.254076:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 176 00000100:00100000:3.0:1783946853.260618:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2364:x1870603507288704:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25104us (25769us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946853.260649:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00010000:00010000:0.0:1783946853.648270:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946854.673820:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783946854.802208:0:8015:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1783946854.802230:0:8015:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:3.0:1783946855.175046:0:12843:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783946855.175055:0:12843:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783946855.175583:0:12843:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1783946855.175593:0:12843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783946855.314333:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523013248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946855.314432:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946855.315236:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523013248 00000100:00100000:0.0:1783946855.315250:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523013248 00000100:00100000:0.0:1783946855.315337:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783946855.315350:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1870603523013248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946855.315388:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33915456 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1783946855.315459:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3447:x1870603523013248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946855.315466:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783946855.315541:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523013248:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783946855.315603:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783946855.340765:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.340886:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507289088 00000100:00100000:2.0:1783946855.340898:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507289088 00000100:00100000:2.0:1783946855.340992:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00100000:2.0:1783946855.341012:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:11483:x1870603507289088:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946855.341039:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946855.341091:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7f3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572162 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.341239:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7f43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.341256:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7f43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.341271:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7f43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946855.341284:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783946855.341418:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7f3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572162 expref: 25 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.341436:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7f43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572162 expref: 24 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.341446:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946855.341449:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783946855.341452:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8000, rc 0) 00000100:00100000:2.0:1783946855.341527:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:11483:x1870603507289088:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 518us (774us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1783946855.341534:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00080000:3.0:1783946855.341897:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946855.343625:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.343838:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507289216 00000100:00100000:2.0:1783946855.343848:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507289216 00000100:00100000:2.0:1783946855.343921:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 192 00000100:00100000:2.0:1783946855.343933:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:11483:x1870603507289216:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1783946855.344028:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344047:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344078:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344108:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344115:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344121:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344216:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344225:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344232:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946855.344284:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344299:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344312:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344319:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344326:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.344331:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344339:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344353:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946855.344356:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.344361:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344797:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7f51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344815:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344822:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344829:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344835:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.344844:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344851:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344860:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91379793ea00) 00010000:00010000:2.0:1783946855.344863:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.344866:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344873:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7f58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344888:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344895:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344902:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344908:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.344911:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344917:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344925:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91379793e400) 00010000:00010000:2.0:1783946855.344927:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.344935:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.344941:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7f5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946855.345033:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:11483:x1870603507289216:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 1100us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946855.345042:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 192 00000100:00100000:3.0:1783946855.407611:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946855.407821:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507289472 00000100:00100000:0.0:1783946855.407835:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507289472 00000100:00100000:0.0:1783946855.407923:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:0.0:1783946855.407938:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:11486:x1870603507289472:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946855.407966:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946855.407994:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7f66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572169 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408125:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408145:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408161:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408178:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408187:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408194:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408343:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408352:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408360:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946855.408394:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1783946855.408501:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408510:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408517:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408523:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946855.408528:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408536:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408551:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:0.0:1783946855.408554:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946855.408559:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408565:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9000/0x229d2ec450db7f6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408578:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408583:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408598:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408603:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946855.408606:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408612:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408620:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137be328800) 00010000:00010000:0.0:1783946855.408623:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946855.408625:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408630:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408674:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7f66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572169 expref: 27 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408689:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572169 expref: 26 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.408696:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:0.0:1783946855.408699:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946855.408701:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8a00, rc 0) 00000100:00100000:0.0:1783946855.408798:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:11486:x1870603507289472:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 863us (1201us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1783946855.408816:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:0.0:1783946855.414784:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946855.414845:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507289600 00000100:00100000:3.0:1783946855.414867:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507289600 00000100:00100000:3.0:1783946855.414944:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 194 00000100:00100000:3.0:1783946855.414957:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:11486:x1870603507289600:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1783946855.415091:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.415234:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.415250:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.415299:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.415306:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.415313:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.415338:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946855.415343:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.415352:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.415367:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:3.0:1783946855.415383:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783946855.415390:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.415397:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7f89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946855.415503:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:11486:x1870603507289600:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 548us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946855.415514:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 194 00000100:00100000:3.0:1783946855.427280:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946855.427439:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507289856 00000100:00100000:0.0:1783946855.427452:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507289856 00000100:00100000:0.0:1783946855.427581:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:0.0:1783946855.427595:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:11486:x1870603507289856:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1783946855.430478:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+27:11486:x1870603507289856:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 2874us (3197us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1783946855.430503:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:0.0:1783946855.505499:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946855.505545:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507290112 00000100:00100000:0.0:1783946855.505554:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507290112 00000100:00100000:0.0:1783946855.505617:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:0.0:1783946855.505628:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+27:11011:x1870603507290112:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946855.505653:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946855.505675:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7f90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572170 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.505782:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.505798:0:7190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572169 expref: 28 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.505807:0:7190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.505859:0:7190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572169 expref: 28 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.505874:0:7190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572169 expref: 28 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946855.506205:0:7190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523013376:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946855.508093:0:7190:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798021b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783946855.512637:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.512695:0:7190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523013376:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783946855.512738:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507290240 00010000:00010000:2.0:1783946855.512742:0:7190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946855.512767:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507290240 00010000:00010000:1.0:1783946855.512817:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572169 expref: 29 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946855.513006:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:1.0:1783946855.513019:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:2362:x1870603507290240:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946855.513040:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946855.513048:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572169 expref: 29 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.513090:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572169 expref: 29 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.513127:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db7f7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572169 expref: 29 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.513144:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:1.0:1783946855.513149:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.513162:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.513172:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.513205:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946855.513292:0:7190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.513301:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946855.513324:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:0.0:1783946855.513367:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:2362:x1870603507290240:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 347us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946855.513387:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00010000:00010000:2.0:1783946855.513502:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db7f90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572170 expref: 29 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.513535:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572170 expref: 28 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.513545:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:2.0:1783946855.513548:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783946855.513551:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9800, rc 0) 00000100:00100000:2.0:1783946855.513592:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:11011:x1870603507290112:12345-192.168.201.18@tcp:101:bash.0 Request processed in 7967us (8102us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783946855.513607:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:1.0:1783946855.523390:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.523596:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507290368 00000100:00100000:2.0:1783946855.523610:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507290368 00000100:00100000:2.0:1783946855.523679:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 196 00000100:00100000:2.0:1783946855.523689:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:11011:x1870603507290368:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946855.523718:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946855.523742:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fa5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572177 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.523776:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7fac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.523790:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.523800:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.523933:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572177 expref: 30 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.523951:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7fac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572177 expref: 29 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.523958:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:2.0:1783946855.523960:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783946855.523963:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9e00, rc 0) 00000100:00100000:2.0:1783946855.524032:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:11011:x1870603507290368:12345-192.168.201.18@tcp:101:bash.0 Request processed in 343us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946855.524046:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 196 00000100:00100000:0.0:1783946855.526975:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946855.527270:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507290624 00000100:00100000:1.0:1783946855.527298:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507290624 00000100:00100000:2.0:1783946855.527500:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:2.0:1783946855.527624:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:11011:x1870603507290624:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:2.0:1783946855.527931:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.527953:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.527967:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783946855.528018:0:7190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1783946855.528047:0:7190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fecc2b5 reply state 0000000093bda9e6 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946855.528113:0:7190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783946855.528764:0:7190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1783946855.528912:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:11011:x1870603507290624:12345-192.168.201.18@tcp:36:bash.0 Request processed in 1399us (1950us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1783946855.528920:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 197 00000020:00080000:2.0:1783946855.528928:0:7190:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1783946855.530859:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.530879:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.530887:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.530894:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946855.530900:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.530908:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.530928:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:1.0:1783946855.530932:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946855.530937:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.530945:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946855.531759:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.531821:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507290752 00000100:00100000:2.0:1783946855.531832:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507290752 00000100:00100000:2.0:1783946855.531902:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 198 00000100:00100000:2.0:1783946855.531915:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+32:11011:x1870603507290752:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946855.531947:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946855.531972:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db7fba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57217e expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.532109:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db7fba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57217e expref: 33 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.532127:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db7fba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57217e expref: 33 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.532150:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:2.0:1783946855.532153:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783946855.532157:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9600, rc 0) 00000100:00100000:2.0:1783946855.532224:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:11011:x1870603507290752:12345-192.168.201.18@tcp:101:bash.0 Request processed in 311us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946855.532231:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 198 00000100:00100000:0.0:1783946855.534753:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946855.534824:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507290880 00000100:00100000:1.0:1783946855.534835:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507290880 00000100:00080000:3.0:1783946855.534903:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946855.534932:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:1.0:1783946855.534946:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:11011:x1870603507290880:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1783946855.534967:0:9002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946855.534994:0:9002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572185 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783946855.535047:0:9002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a54de63, atime: 0x6a54de61, ctime: 0x6a54de63, blocks: 0x8 00010000:00010000:1.0:1783946855.535131:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1783946855.535137:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946855.535148:0:9002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572185 expref: 8 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.535171:0:9002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572185 expref: 8 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.535186:0:9002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44a00, rc 0) 00000100:00100000:1.0:1783946855.535262:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:11011:x1870603507290880:12345-192.168.201.18@tcp:101:bash.0 Request processed in 319us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946855.535271:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:1.0:1783946855.538086:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946855.540250:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507291008 00000100:00100000:0.0:1783946855.540269:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507291008 00002000:00010000:0.0:1783946855.540337:0:6949:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1783946855.540343:0:6949:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be946d80 with x1870603507291008 ext(0->18446744073709551615) 00002000:00010000:0.0:1783946855.540359:0:6949:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be946d80. 00000100:00100000:0.0:1783946855.540402:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:0.0:1783946855.540414:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2363:x1870603507291008:12345-192.168.201.18@tcp:10:bash.0 00002000:00010000:0.0:1783946855.541269:0:6949:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783946855.541276:0:6949:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783946851 -> 1783946855 00002000:00010000:0.0:1783946855.541278:0:6949:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1783946849 -> 1783946849 00002000:00010000:0.0:1783946855.541294:0:6949:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783946851 -> 1783946855 00002000:00010000:0.0:1783946855.541296:0:6949:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1783946855.541431:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2363:x1870603507291008:12345-192.168.201.18@tcp:10:bash.0 Request processed in 1018us (3379us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783946855.541442:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00002000:00010000:0.0:1783946855.541448:0:6949:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1783946855.541451:0:6949:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be946d80 with x1870603507291008 ext(0->18446744073709551615) 00002000:00010000:0.0:1783946855.541458:0:6949:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be946d80. 00000100:00100000:0.0:1783946855.618209:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.618340:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507291136 00000100:00100000:2.0:1783946855.618354:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507291136 00000100:00100000:2.0:1783946855.618438:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:2.0:1783946855.618460:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:11500:x1870603507291136:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1783946855.618564:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618586:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618601:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618618:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618648:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618656:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618759:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618770:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618777:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946855.618832:0:7190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618846:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618853:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618861:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618868:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.618873:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618881:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618903:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946855.618906:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.618912:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618920:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db7fc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618940:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618947:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618953:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618960:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.618963:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618970:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618978:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91379793e400) 00010000:00010000:2.0:1783946855.618980:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.618983:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.618990:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db7fcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.619015:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.619023:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.619029:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.619035:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.619038:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.619045:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.619053:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:2.0:1783946855.619055:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.619138:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.619146:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db7fd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946855.619248:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:11500:x1870603507291136:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 799us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946855.619258:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:2.0:1783946855.674000:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946855.678670:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507291392 00000100:00100000:3.0:1783946855.678692:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507291392 00000100:00100000:3.0:1783946855.678799:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 200 00000100:00100000:3.0:1783946855.678814:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+33:11503:x1870603507291392:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946855.678842:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946855.678873:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7fdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57218c expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.678972:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.679010:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.679024:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.679042:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.679050:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.679056:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.679246:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.679256:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.679263:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946855.679274:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783946855.680455:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.680470:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.680926:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.680952:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946855.680958:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.680967:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.680986:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:3.0:1783946855.680989:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946855.680995:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681002:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db7fe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681022:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681028:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681034:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681039:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946855.681042:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681048:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681134:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137983e1d00) 00010000:00010000:3.0:1783946855.681137:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946855.681141:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681147:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db7feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681227:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db7fdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57218c expref: 36 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681246:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57218c expref: 35 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.681254:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:3.0:1783946855.681256:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783946855.681260:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030800, rc 0) 00000100:00100000:3.0:1783946855.683003:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:11503:x1870603507291392:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 4179us (9005us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1783946855.683020:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 200 00000100:00100000:1.0:1783946855.690439:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946855.690565:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507291520 00000100:00100000:0.0:1783946855.690579:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507291520 00000100:00100000:0.0:1783946855.690673:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:0.0:1783946855.690687:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:11503:x1870603507291520:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:0.0:1783946855.690785:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.690807:0:5957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572170 expref: 35 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.690819:0:5957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.690867:0:5957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572170 expref: 35 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.690884:0:5957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572170 expref: 35 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946855.690939:0:5957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523013504:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946855.691114:0:5957:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798021180 going to sleep for 11 seconds 00000100:00100000:1.0:1783946855.697206:0:5957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5957:1870603523013504:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783946855.697246:0:5957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946855.697331:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.697434:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507291776 00000100:00100000:2.0:1783946855.697444:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507291776 00010000:00010000:0.0:1783946855.697627:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946855.705326:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1783946855.705365:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:5449:x1870603507291776:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783946855.706109:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:5449:x1870603507291776:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 762us (8775us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1783946855.706118:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:1.0:1783946855.710411:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.710630:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507291904 00000100:00100000:2.0:1783946855.710643:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507291904 00010000:00010000:2.0:1783946855.710699:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572170 expref: 37 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946855.710858:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:2.0:1783946855.710870:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:2361:x1870603507291904:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946855.710954:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946855.710965:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572170 expref: 37 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.710981:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572170 expref: 37 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.711010:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9800/0x229d2ec450db7f97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572170 expref: 37 pid: 7190 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.711031:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:2.0:1783946855.711037:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.711049:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.711156:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.711517:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946855.711599:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:2361:x1870603507291904:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 729us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946855.711608:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00010000:00010000:1.0:1783946855.717414:0:5957:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.717439:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.717532:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.717541:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.717549:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.717557:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946855.717561:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.717570:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.717592:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:1.0:1783946855.717596:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783946855.717601:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.717608:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8c00/0x229d2ec450db8000 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946855.717971:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:11503:x1870603507291520:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 27279us (27538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946855.717984:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:1.0:1783946855.721256:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946855.721356:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507292160 00000100:00100000:0.0:1783946855.721368:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507292160 00000100:00100000:0.0:1783946855.722333:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:0.0:1783946855.722355:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+35:11503:x1870603507292160:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1783946855.722691:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:11503:x1870603507292160:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 344us (1448us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1783946855.722700:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:0.0:1783946855.814264:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.814411:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507292416 00000100:00100000:2.0:1783946855.814424:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507292416 00000100:00100000:2.0:1783946855.814508:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 202 00000100:00100000:2.0:1783946855.814520:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:11514:x1870603507292416:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:2.0:1783946855.814554:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946855.814581:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8007 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572193 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.814676:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.814693:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.814707:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.814723:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.814742:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.814772:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.814936:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db801c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.814947:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db801c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.814955:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db801c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946855.814968:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1783946855.815130:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815139:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815146:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815153:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.815158:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815167:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815182:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946855.815185:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.815199:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815205:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db800e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815222:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815228:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815234:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815240:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.815244:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815249:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815257:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91379793e400) 00010000:00010000:2.0:1783946855.815260:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.815263:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815269:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8015 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815318:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8007 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572193 expref: 39 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815347:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db801c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572193 expref: 38 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.815356:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:2.0:1783946855.815359:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946855.815362:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9c00, rc 0) 00000100:00100000:2.0:1783946855.815442:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+38:11514:x1870603507292416:12345-192.168.201.18@tcp:101:cat.0 Request processed in 924us (1192us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1783946855.815452:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 202 00000100:00100000:3.0:1783946855.827212:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.827432:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507292672 00000100:00100000:2.0:1783946855.827446:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507292672 00000100:00100000:2.0:1783946855.827522:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:2.0:1783946855.827535:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+38:11514:x1870603507292672:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:2.0:1783946855.827939:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+39:11514:x1870603507292672:12345-192.168.201.18@tcp:35:cat.0 Request processed in 405us (741us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1783946855.827948:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:1.0:1783946855.856608:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.856717:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507292928 00000100:00100000:2.0:1783946855.856739:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507292928 00000100:00100000:2.0:1783946855.856814:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:2.0:1783946855.856825:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+39:11515:x1870603507292928:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:2.0:1783946855.856914:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1783946855.856952:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db7fba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57217e expref: 39 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.856980:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db801c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572193 expref: 38 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857020:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030800/0x229d2ec450db7ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57218c expref: 37 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857035:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db7fac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572177 expref: 36 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857046:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9137be328200) 00010000:00010000:2.0:1783946855.857395:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946855.857426:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857442:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857453:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857468:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857474:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857480:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857585:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857594:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.857609:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783946855.858247:0:7190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1783946855.858260:0:7190:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 459777199685ns, next at 460777196492ns, rc = 0 00010000:00010000:2.0:1783946855.858318:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858328:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858336:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858344:0:7190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858351:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858357:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858383:0:7190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946855.858410:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858416:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858423:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858440:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.858445:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858453:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858464:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91379793ea00) 00010000:00010000:2.0:1783946855.858467:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783946855.858472:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858478:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db8038 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858497:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858503:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858508:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858513:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.858517:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858522:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858541:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946855.858543:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.858546:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.858552:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db802a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946855.858564:0:7190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a9daf27 reply state 000000002d02b518 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946855.858574:0:7190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783946855.858694:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+37:11515:x1870603507292928:12345-192.168.201.18@tcp:36:rm.0 Request processed in 1866us (2096us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1783946855.858703:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 203 00010000:00010000:1.0:1783946855.859599:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946855.859619:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.859627:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946855.859632:0:5944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.859639:0:5944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.859650:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91379793ea00) 00010000:00010000:1.0:1783946855.859652:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783946855.859656:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.859661:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db803f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.859681:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946855.859684:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946855.859685:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946855.861051:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.861106:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.861115:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.861121:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946855.861134:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.861142:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.861176:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91379793e400) 00010000:00010000:0.0:1783946855.861179:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946855.861184:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.861190:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8031 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946855.923024:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.923202:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507293184 00000100:00100000:2.0:1783946855.923215:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507293184 00000100:00100000:2.0:1783946855.923291:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 204 00000100:00100000:2.0:1783946855.923304:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+36:11521:x1870603507293184:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946855.923348:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946855.923375:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8046 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57219a expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.923501:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.923520:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.923554:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.923570:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.923577:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.923583:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783946855.923997:0:5956:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1783946855.924197:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924207:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924214:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924249:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924256:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924263:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924270:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946855.924282:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924290:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924304:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946855.924308:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946855.924312:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924320:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db804d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946855.924332:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084b00f85 reply state 00000000a491e022 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946855.924341:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783946855.924370:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8046 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57219a expref: 39 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924383:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57219a expref: 38 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.924391:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e500) 00010000:00010000:2.0:1783946855.924394:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946855.924396:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9c00, rc 0) 00000100:00100000:2.0:1783946855.924474:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+39:11521:x1870603507293184:12345-192.168.201.18@tcp:101:bash.0 Request processed in 1173us (1464us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1783946855.924482:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 204 00010000:00010000:3.0:1783946855.928843:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.928867:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.928894:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.928901:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946855.928907:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.928917:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946855.928932:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:3.0:1783946855.928940:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91379793e700) 00010000:00010000:3.0:1783946855.928945:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946855.928951:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946855.928958:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8054 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946855.929158:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507293312 00000100:00100000:0.0:1783946855.929169:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507293312 00000100:00100000:0.0:1783946855.929233:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:0.0:1783946855.929242:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2362:x1870603507293312:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946855.929262:0:6944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946855.929281:0:6944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721a1 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783946855.929296:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1783946855.929304:0:6944:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946855.929324:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1783946855.929328:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946855.929337:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a1 expref: 6 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.929351:0:6944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a1 expref: 6 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946855.929361:0:6944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8e00, rc 0) 00000100:00100000:0.0:1783946855.929419:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507293312:12345-192.168.201.18@tcp:101:bash.0 Request processed in 178us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946855.929431:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:0.0:1783946855.933482:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.933563:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507293440 00000100:00100000:2.0:1783946855.933576:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507293440 00000100:00100000:2.0:1783946855.933643:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:2.0:1783946855.933653:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:11521:x1870603507293440:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946855.933675:0:6945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946855.933697:0:6945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721a8 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.933738:0:6945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a1 expref: 7 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.933749:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946855.933753:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946855.933759:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 7 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.933803:0:6945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a1 expref: 7 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.933819:0:6945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a1 expref: 7 pid: 6944 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946855.933835:0:6945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6945:1870603523013632:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946855.933945:0:6945:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028780 going to sleep for 11 seconds 00000100:00100000:2.0:1783946855.937356:0:6945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6945:1870603523013632:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946855.937401:0:6945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 7 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946855.937443:0:6945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8800, rc 0) 00000100:00100000:2.0:1783946855.937512:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:11521:x1870603507293440:12345-192.168.201.18@tcp:101:bash.0 Request processed in 3854us (4037us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946855.937520:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:0.0:1783946855.938260:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946855.938359:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507293568 00000100:00100000:1.0:1783946855.938368:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507293568 00010000:00010000:1.0:1783946855.938413:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a1 expref: 7 pid: 6944 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946855.938455:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:1.0:1783946855.938466:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507293568:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946855.938483:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946855.938520:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a1 expref: 7 pid: 6944 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.938534:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a1 expref: 7 pid: 6944 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.938560:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7d53995/0x229d2ec450db8069 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a1 expref: 7 pid: 6944 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.938574:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946855.938579:0:5943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946855.938590:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 6 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.938600:0:5943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 6 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946855.938641:0:5943:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 6 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946855.938656:0:5943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5943:1870603523013760:192.168.201.18@tcp:105: 00000100:00100000:1.0:1783946855.938745:0:5943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137927806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946855.941362:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946855.941437:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507293824 00000100:00100000:2.0:1783946855.941445:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507293824 00000100:00100000:1.0:1783946855.941476:0:5943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5943:1870603523013760:192.168.201.18@tcp:105: 00000100:00100000:2.0:1783946855.941496:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00010000:00010000:1.0:1783946855.941503:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946855.941515:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+38:11521:x1870603507293824:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:1.0:1783946855.941566:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2362:x1870603507293568:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 3101us (3308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946855.941598:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:2.0:1783946855.941849:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+39:11521:x1870603507293824:12345-192.168.201.18@tcp:35:bash.0 Request processed in 344us (538us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1783946855.941866:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:0.0:1783946856.072231:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946856.073479:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507293952 00000100:00100000:1.0:1783946856.073495:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507293952 00000100:00100000:1.0:1783946856.073590:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:1.0:1783946856.073604:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+39:11537:x1870603507293952:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1783946856.073639:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946856.073666:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db8077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721af expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.073754:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db807e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.073773:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db807e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.073786:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db807e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946856.073846:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783946856.073851:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783946856.073874:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db807e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.073972:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db8077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721af expref: 41 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.073995:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db807e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721af expref: 40 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.074028:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:1.0:1783946856.074032:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783946856.074036:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45800, rc 0) 00000100:00100000:1.0:1783946856.074200:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+40:11537:x1870603507293952:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 598us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946856.074209:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:1.0:1783946856.084398:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946856.084696:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507294208 00000100:00100000:2.0:1783946856.084710:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507294208 00000100:00100000:2.0:1783946856.084790:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:2.0:1783946856.084803:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+40:11537:x1870603507294208:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946856.084832:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946856.084859:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721b6 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.085054:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db808c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.085154:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db808c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.085173:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db808c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946856.085196:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783946856.085341:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721b6 expref: 43 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.085365:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db808c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721b6 expref: 42 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.085375:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e500) 00010000:00010000:2.0:1783946856.085378:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946856.085382:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9400, rc 0) 00000100:00100000:2.0:1783946856.085455:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:11537:x1870603507294208:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 654us (1071us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1783946856.085463:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:0.0:1783946856.091490:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.093184:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507294336 00000100:00100000:3.0:1783946856.093202:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507294336 00000100:00100000:3.0:1783946856.093302:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1783946856.093314:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+42:2363:x1870603507294336:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946856.093336:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946856.093369:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9400/0x229d2ec450db808c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721b6 expref: 42 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.093394:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e500) 00010000:00010000:3.0:1783946856.093417:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946856.093499:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:2363:x1870603507294336:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 187us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946856.093508:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:0.0:1783946856.099124:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946856.099266:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507294592 00000100:00100000:1.0:1783946856.099277:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507294592 00000100:00100000:1.0:1783946856.099354:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:1.0:1783946856.099367:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+41:11537:x1870603507294592:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1783946856.099400:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946856.099428:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db809a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721bd expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.099583:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db80a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.099604:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db80a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.099620:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db80a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783946856.099636:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783946856.099777:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db809a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721bd expref: 44 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.099825:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db80a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721bd expref: 43 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946856.099835:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e500) 00010000:00010000:1.0:1783946856.099838:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783946856.099842:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44e00, rc 0) 00000100:00100000:1.0:1783946856.099934:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+43:11537:x1870603507294592:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 570us (826us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1783946856.099943:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:1.0:1783946856.113293:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.113421:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507294720 00000100:00100000:0.0:1783946856.113435:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507294720 00000100:00100000:0.0:1783946856.113519:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:0.0:1783946856.113531:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+6:2361:x1870603507294720:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:0.0:1783946856.113592:0:6944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.113618:0:6944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 6 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.113630:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783946856.113636:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946856.113643:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.113826:0:6944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 6 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.113843:0:6944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 6 pid: 6945 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946856.113880:0:6944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6944:1870603523013888:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946856.114223:0:6944:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798021840 going to sleep for 11 seconds 00000100:00100000:0.0:1783946856.120854:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.121020:0:6944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6944:1870603523013888:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946856.121057:0:6944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.121358:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507294848 00000100:00100000:2.0:1783946856.121368:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507294848 00002000:00100000:2.0:1783946856.121433:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9137be7d4000 x1870603507294848/t0(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:402/0 lens 504/0 e 0 to 0 dl 1783946867 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783946856.121444:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be7d4000 with x1870603507294848 ext(0->8) 00010000:00010000:2.0:1783946856.121453:0:6948:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 7 pid: 6945 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.121471:0:6948:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 7 pid: 6945 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783946856.121480:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9137be7d4000 00000100:00100000:2.0:1783946856.121522:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:2.0:1783946856.121541:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507294848:12345-192.168.201.18@tcp:4:lfs.0 00000100:00100000:2.0:1783946856.123103:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2361:x1870603507294848:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 1516us (2216us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783946856.123124:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00002000:00100000:2.0:1783946856.123140:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9137be7d4000 x1870603507294848/t4294967308(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:402/0 lens 504/448 e 0 to 0 dl 1783946867 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783946856.123152:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be7d4000 with x1870603507294848 ext(0->8) 00010000:00010000:2.0:1783946856.123162:0:6948:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 9 pid: 6945 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.123182:0:6948:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 9 pid: 6945 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783946856.123191:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9137be7d4000 00000100:00100000:3.0:1783946856.135301:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.135763:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507294976 00000100:00100000:0.0:1783946856.135775:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507294976 00010000:00010000:0.0:1783946856.135835:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 9 pid: 6945 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946856.135895:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:0.0:1783946856.135907:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2364:x1870603507294976:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946856.135927:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783946856.135953:0:8023:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783946856.135957:0:8023:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783946856 00002000:00010000:0.0:1783946856.135960:0:8023:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783946856 00002000:00010000:0.0:1783946856.135963:0:8023:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783946856 00002000:00010000:0.0:1783946856.135966:0:8023:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783946856.135973:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 9 pid: 6945 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.135988:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 9 pid: 6945 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.136021:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3ca9421/0x229d2ec450db8070 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721a8 expref: 9 pid: 6945 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.136123:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946856.136129:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946856.136137:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.136148:0:8023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.136196:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946856.136271:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2364:x1870603507294976:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 366us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946856.136280:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00010000:00010000:2.0:1783946856.136483:0:6944:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.136495:0:6944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.136521:0:6944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.136532:0:6944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.136555:0:6944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.136563:0:6944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946856.136569:0:6944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.136579:0:6944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.136592:0:6944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.136600:0:6944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db80af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.136661:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507294720:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 23132us (23384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946856.136683:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:1.0:1783946856.142961:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.143049:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507295232 00000100:00100000:0.0:1783946856.143091:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507295232 00000100:00100000:0.0:1783946856.143177:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:0.0:1783946856.143190:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a07e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+43:11537:x1870603507295232:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:0.0:1783946856.143274:0:5960:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db80a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721bd expref: 43 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783946856.143526:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1783946856.143556:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1783946856.143933:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1783946856.143978:0:5960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.143996:0:5960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57219a expref: 47 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.144027:0:5960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.144129:0:5960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57219a expref: 47 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.144146:0:5960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57219a expref: 47 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946856.144165:0:5960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5960:1870603523014016:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946856.144290:0:5960:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798021180 going to sleep for 11 seconds 00000100:00100000:0.0:1783946856.148288:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.149044:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507295360 00000100:00100000:3.0:1783946856.149096:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507295360 00010000:00010000:3.0:1783946856.149165:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57219a expref: 48 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946856.149219:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:3.0:1783946856.149231:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+48:2362:x1870603507295360:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946856.149251:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946856.149260:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57219a expref: 48 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.149275:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57219a expref: 48 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.149316:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e500) 00010000:00010000:3.0:1783946856.149323:0:5942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.149358:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.149368:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.149391:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946856.149476:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+48:2362:x1870603507295360:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 247us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946856.149486:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00010000:00010000:2.0:1783946856.156469:0:5960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db805b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57219a expref: 47 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.156508:0:5960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5960:1870603523014016:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946856.156542:0:5960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.156583:0:5960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.156591:0:5960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783946856.161626:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1783946856.161953:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1783946856.162521:0:5960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5960:1870603523014144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783946856.162618:0:5960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946856.162657:0:5960:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028780 going to sleep for 11 seconds 00000100:00100000:1.0:1783946856.162782:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523014144 00000100:00100000:1.0:1783946856.162791:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523014144 00000100:00100000:1.0:1783946856.162882:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783946856.162894:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5960:x1870603523014144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783946856.163016:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5960:x1870603523014144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946856.163025:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783946856.163170:0:5960:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1783946856.163181:0:5960:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1783946856.163214:0:5960:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be6fed80, transno 4294967307 00000100:00100000:0.0:1783946856.163244:0:5960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5960:1870603523014144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783946856.163480:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1783946856.163594:0:5960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5960:1870603523014272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783946856.163663:0:5960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946856.163694:0:5960:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798021840 going to sleep for 11 seconds 00000100:00080000:3.0:1783946856.164139:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946856.164378:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523014272 00000100:00100000:1.0:1783946856.164388:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523014272 00000100:00100000:1.0:1783946856.164433:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783946856.164444:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5960:x1870603523014272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783946856.164609:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5960:x1870603523014272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 166us (945us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783946856.164618:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783946856.166330:0:5960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5960:1870603523014272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783946856.166455:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1783946856.166542:0:5960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.166555:0:5960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.166586:0:5960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.166594:0:5960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946856.166600:0:5960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.166608:0:5960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.166630:0:5960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e500) 00010000:00010000:0.0:1783946856.166635:0:5960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783946856.166640:0:5960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.166648:0:5960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783946856.166975:0:5960:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783946856.167383:0:5960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1783946856.167402:0:5960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 460086341411ns, next at 461086338464ns, rc = 0 00000001:00080000:0.0:1783946856.167412:0:5960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1783946856.167450:0:5960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e500) 00010000:00010000:0.0:1783946856.167454:0:5960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783946856.167463:0:5960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44e00/0x229d2ec450db80a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721bd expref: 51 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946856.167611:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a07e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:11537:x1870603507295232:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 24422us (24664us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1783946856.167635:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000020:00080000:0.0:1783946856.167643:0:5960:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783946856.172123:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946856.172287:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507295488 00000100:00100000:2.0:1783946856.172302:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507295488 00000100:00100000:2.0:1783946856.172458:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 208 00000100:00100000:2.0:1783946856.172471:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+50:11537:x1870603507295488:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946856.172505:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946856.172538:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db80bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721c4 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.172620:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db80bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721c4 expref: 51 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.172638:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db80bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721c4 expref: 51 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.172662:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:2.0:1783946856.172889:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783946856.172918:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9c00, rc 0) 00000100:00100000:2.0:1783946856.173053:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+51:11537:x1870603507295488:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 582us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946856.173104:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 208 00000100:00100000:1.0:1783946856.189768:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.189833:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507295744 00000100:00100000:3.0:1783946856.189847:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507295744 00000100:00100000:1.0:1783946856.192566:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:1.0:1783946856.192583:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+51:11537:x1870603507295744:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1783946856.192920:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:11537:x1870603507295744:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 341us (3164us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1783946856.192930:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:1.0:1783946856.258618:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.258734:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507295872 00000100:00100000:0.0:1783946856.258747:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507295872 00000100:00100000:0.0:1783946856.258831:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:0.0:1783946856.258843:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:11547:x1870603507295872:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:0.0:1783946856.259179:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259202:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259216:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259233:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259241:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259247:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259359:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259365:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259389:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783946856.259439:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259451:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259456:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259461:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259465:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946856.259468:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259474:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259484:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:0.0:1783946856.259486:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946856.259490:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259493:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259503:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259512:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259515:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259518:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946856.259520:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259523:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259527:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137be328a00) 00010000:00010000:0.0:1783946856.259528:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946856.259530:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259533:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259545:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259548:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259551:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259555:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946856.259560:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259564:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259568:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946856.259569:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946856.259571:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.259574:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946856.259654:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:11547:x1870603507295872:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 813us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946856.259662:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:2.0:1783946856.296319:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.296452:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507296128 00000100:00100000:0.0:1783946856.296465:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507296128 00000100:00100000:0.0:1783946856.296546:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:0.0:1783946856.296558:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+52:11550:x1870603507296128:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946856.296586:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946856.296614:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721cb expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.296713:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.296741:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.296779:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.296797:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.296805:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.296812:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.296970:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.296980:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.296988:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946856.297001:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783946856.297151:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297160:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297168:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297174:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946856.297186:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297195:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297210:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:0.0:1783946856.297213:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946856.297219:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297227:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db80e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297243:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297250:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297256:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297262:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946856.297265:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297272:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297279:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137be328a00) 00010000:00010000:0.0:1783946856.297281:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946856.297290:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297295:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db80e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297344:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db80d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721cb expref: 55 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297360:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721cb expref: 54 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.297369:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946856.297371:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946856.297374:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a9c00, rc 0) 00000100:00100000:0.0:1783946856.297462:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:11550:x1870603507296128:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 905us (1154us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1783946856.297470:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:1.0:1783946856.300560:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946856.300665:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507296256 00000100:00100000:2.0:1783946856.300677:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507296256 00000100:00100000:2.0:1783946856.300752:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:2.0:1783946856.300765:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:11550:x1870603507296256:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1783946856.300960:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.304444:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.304476:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.304535:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.304544:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.304553:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.304560:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946856.304566:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.304604:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.304619:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:2.0:1783946856.304623:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946856.304628:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.304634:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db80fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.304769:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:11550:x1870603507296256:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 4001us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946856.305370:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:1.0:1783946856.311500:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946856.311594:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507296512 00000100:00100000:2.0:1783946856.311606:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507296512 00000100:00100000:2.0:1783946856.311680:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:2.0:1783946856.311694:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+54:11550:x1870603507296512:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1783946856.312038:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:11550:x1870603507296512:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 346us (555us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1783946856.312047:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:0.0:1783946856.336396:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523014400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946856.336492:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946856.336703:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523014912:0@lo:400:kworker.0 00000100:00100000:2.0:1783946856.336737:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946856.336760:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946856.336768:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603523014784:0@lo:400:kworker.0 00000100:00100000:3.0:1783946856.336802:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523014400 00000100:00100000:3.0:1783946856.336814:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523014400 00000100:00100000:2.0:1783946856.336828:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946856.336886:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783946856.336899:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3448:x1870603523014400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783946856.336930:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42381888 pending 28672 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946856.337006:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3448:x1870603523014400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946856.337014:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783946856.337099:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523014656:0@lo:400:kworker.0 00000100:00100000:1.0:1783946856.337145:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946856.337180:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783946856.337186:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523014528:0@lo:400:kworker.0 00000100:00100000:1.0:1783946856.337214:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946856.337231:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603523015040:0@lo:400:kworker.0 00000100:00100000:1.0:1783946856.337257:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946856.337284:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523014528 00000100:00100000:1.0:1783946856.337288:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523014528 00000100:00100000:3.0:1783946856.337290:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523014784 00000100:00100000:3.0:1783946856.337296:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523014784 00000100:00100000:1.0:1783946856.337321:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00080000:3.0:1783946856.337326:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946856.337341:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603523014528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946856.337361:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523014656 00000100:00100000:3.0:1783946856.337366:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523014656 00000100:00100000:3.0:1783946856.337386:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523015040 00000100:00100000:1.0:1783946856.337390:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603523014528:12345-0@lo:400:kworker.0 Request processed in 59us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946856.337391:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523015040 00000100:00100000:1.0:1783946856.337401:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:3.0:1783946856.337412:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946856.337439:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783946856.337450:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603523014784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946856.337464:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523014528:0@lo:400:kworker.0 00000100:00100000:3.0:1783946856.337497:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603523014784:12345-0@lo:400:kworker.0 Request processed in 48us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946856.337498:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523014912 00000100:00100000:3.0:1783946856.337507:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783946856.337509:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523014912 00000100:00100000:1.0:1783946856.337537:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783946856.337541:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3448:x1870603523014912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946856.337567:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913787e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3448:x1870603523014912:12345-0@lo:400:kworker.0 Request processed in 25us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946856.337571:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783946856.337705:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783946856.337715:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523014656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946856.337761:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783946856.337766:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523014656:12345-0@lo:400:kworker.0 Request processed in 51us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946856.337775:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603523015040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946856.337778:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1783946856.337820:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603523015040:12345-0@lo:400:kworker.0 Request processed in 50us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946856.337826:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783946856.338210:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603523014784:0@lo:400:kworker.0 00000100:00100000:2.0:1783946856.338226:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523014912:0@lo:400:kworker.0 00000100:00100000:2.0:1783946856.338240:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523014400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946856.338350:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603523015040:0@lo:400:kworker.0 00000100:00100000:1.0:1783946856.338362:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523014656:0@lo:400:kworker.0 00000100:00100000:0.0:1783946856.383707:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.383808:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507296768 00000100:00100000:3.0:1783946856.383821:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507296768 00000100:00100000:3.0:1783946856.383900:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:3.0:1783946856.383913:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:11560:x1870603507296768:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1783946856.383946:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946856.383951:0:5956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783946856.383999:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45800/0x229d2ec450db807e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721af expref: 55 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.384025:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:3.0:1783946856.384031:0:5956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946856.384051:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db8103 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721d2 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.384310:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.384353:0:5956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721cb expref: 55 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.384364:0:5956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.384410:0:5956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721cb expref: 55 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.384428:0:5956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721cb expref: 55 pid: 5958 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946856.384445:0:5956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be845500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523015168:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783946856.384572:0:5956:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be84e480 going to sleep for 11 seconds 00000100:00100000:1.0:1783946856.388431:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.388678:0:5956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be845500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523015168:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783946856.388725:0:5956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946856.388930:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507296896 00000100:00100000:0.0:1783946856.388941:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507296896 00010000:00010000:0.0:1783946856.389021:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721cb expref: 56 pid: 5958 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946856.389250:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:0.0:1783946856.389263:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3531450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:2361:x1870603507296896:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946856.389286:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946856.389295:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721cb expref: 56 pid: 5958 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.389310:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721cb expref: 56 pid: 5958 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.389339:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db80ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721cb expref: 56 pid: 5958 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.389360:0:8023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946856.389366:0:8023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.389378:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.389387:0:8023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.389416:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946856.389569:0:5956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.389578:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946856.389602:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783946856.389786:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db8103 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d2 expref: 57 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.389812:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d2 expref: 56 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.389820:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:3.0:1783946856.389824:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783946856.389826:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031200, rc 0) 00000100:00100000:0.0:1783946856.389885:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3531450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:2361:x1870603507296896:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 623us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946856.389895:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:3.0:1783946856.390329:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:11560:x1870603507296768:12345-192.168.201.18@tcp:101:bash.0 Request processed in 6417us (6638us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1783946856.390339:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:1.0:1783946856.392973:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.393104:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507297024 00000100:00100000:0.0:1783946856.393165:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507297024 00000100:00100000:0.0:1783946856.393239:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:0.0:1783946856.393251:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+55:11560:x1870603507297024:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783946856.393283:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946856.393307:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8118 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721d9 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.393354:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.393372:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.393386:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.393542:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d9 expref: 57 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.393562:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d9 expref: 56 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.393572:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946856.393575:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783946856.393578:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8e00, rc 0) 00000100:00100000:0.0:1783946856.393699:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:11560:x1870603507297024:12345-192.168.201.18@tcp:101:bash.0 Request processed in 450us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946856.393708:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:2.0:1783946856.400712:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.400810:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507297280 00000100:00100000:0.0:1783946856.400822:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507297280 00000100:00100000:0.0:1783946856.400901:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 214 00000100:00100000:0.0:1783946856.400912:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+56:11560:x1870603507297280:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:0.0:1783946856.401551:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.401577:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.401593:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783946856.401649:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1783946856.401677:0:5958:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a020308d reply state 00000000898869e5 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946856.401689:0:5958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783946856.401815:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:11560:x1870603507297280:12345-192.168.201.18@tcp:36:bash.0 Request processed in 903us (1118us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1783946856.401823:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 214 00000020:00080000:0.0:1783946856.401830:0:5958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783946856.404186:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:0.0:1783946856.404286:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.404301:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.404308:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.404316:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946856.404343:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.404353:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.404372:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946856.404375:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946856.404381:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.404388:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8126 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.404910:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507297408 00000100:00100000:2.0:1783946856.404923:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507297408 00000100:00100000:2.0:1783946856.404994:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:2.0:1783946856.405006:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:11560:x1870603507297408:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1783946856.405034:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946856.405056:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db812d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721e0 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.405224:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.405242:0:7190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d2 expref: 59 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.405251:0:7190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.405297:0:7190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d2 expref: 59 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.405314:0:7190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d2 expref: 59 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.405333:0:7190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beaca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523015296:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946856.405460:0:7190:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ae73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946856.408584:0:7190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beaca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523015296:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946856.408622:0:7190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946856.409955:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.410322:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507297536 00000100:00100000:3.0:1783946856.410334:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507297536 00010000:00010000:3.0:1783946856.410389:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d2 expref: 60 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946856.410440:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:3.0:1783946856.410451:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:2361:x1870603507297536:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946856.410472:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946856.410481:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d2 expref: 60 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.410495:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d2 expref: 60 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.410524:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db810a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d2 expref: 60 pid: 5956 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.410574:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:3.0:1783946856.410580:0:5942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.410590:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.410600:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.410636:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946856.410717:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:2361:x1870603507297536:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 265us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946856.410726:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00010000:00010000:2.0:1783946856.410813:0:7190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.410823:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946856.410901:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783946856.410905:0:7190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783946856.410927:0:7190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.410964:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db812d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e0 expref: 59 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.410982:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e0 expref: 58 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.410991:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:2.0:1783946856.410994:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946856.410996:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8400, rc 0) 00000100:00100000:2.0:1783946856.411020:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:11560:x1870603507297408:12345-192.168.201.18@tcp:101:bash.0 Request processed in 6018us (6849us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946856.411025:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:1.0:1783946856.414379:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.414480:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507297792 00000100:00100000:0.0:1783946856.414493:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507297792 00000100:00100000:0.0:1783946856.414567:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:0.0:1783946856.414581:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+58:11560:x1870603507297792:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:0.0:1783946856.414901:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:11560:x1870603507297792:12345-192.168.201.18@tcp:35:bash.0 Request processed in 321us (537us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1783946856.414909:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:1.0:1783946856.485695:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.485973:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507297920 00000100:00100000:3.0:1783946856.485988:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507297920 00000100:00100000:3.0:1783946856.486278:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:3.0:1783946856.486293:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+59:11566:x1870603507297920:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946856.486326:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946856.486372:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db813b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721e7 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.486468:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db8142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.486486:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db8142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.486500:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db8142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946856.486581:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783946856.486585:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946856.486610:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db8142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.486641:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db813b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e7 expref: 61 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.486669:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db8142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e7 expref: 60 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.486680:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:3.0:1783946856.486684:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946856.486688:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030200, rc 0) 00000100:00100000:3.0:1783946856.486778:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:11566:x1870603507297920:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 488us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946856.486786:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:1.0:1783946856.492441:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.492560:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507298048 00000100:00100000:0.0:1783946856.492573:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507298048 00000100:00100000:0.0:1783946856.492652:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:0.0:1783946856.492664:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:11566:x1870603507298048:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783946856.492691:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946856.492837:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8149 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721ee expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493244:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493263:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493277:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493294:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493300:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493307:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493466:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493477:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493484:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946856.493539:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783946856.493544:0:5957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946856.493566:0:5957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493592:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493601:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493607:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493614:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493620:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946856.493625:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493634:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493647:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:0.0:1783946856.493651:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946856.493656:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493664:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8150 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493679:0:5957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493686:0:5957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493699:0:5957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493704:0:5957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946856.493708:0:5957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493783:0:5957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493794:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9137be328a00) 00010000:00010000:0.0:1783946856.493797:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946856.493800:0:5957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493805:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8157 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493846:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9c00/0x229d2ec450db8149 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 62 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493861:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 61 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.493870:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946856.493872:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946856.493874:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8400, rc 0) 00000100:00100000:0.0:1783946856.494022:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11566:x1870603507298048:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1358us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946856.494041:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:1.0:1783946856.499207:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946856.499259:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946856.499407:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507298432 00000100:00100000:2.0:1783946856.499439:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507298432 00000100:00100000:2.0:1783946856.499515:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 218 00000100:00100000:2.0:1783946856.499528:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11566:x1870603507298432:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946856.499559:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946856.499588:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db8165 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721f5 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.499751:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.499771:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e0 expref: 62 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.499781:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 62 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.499792:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.499838:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 62 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.499855:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 62 pid: 5957 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.499870:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beaca300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523015424:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946856.500005:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e0 expref: 62 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.500026:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e0 expref: 62 pid: 7190 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.500036:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beacad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523015552:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946856.500114:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ae73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946856.500313:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507298304 00000100:00100000:0.0:1783946856.500320:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507298304 00010000:00010000:0.0:1783946856.500362:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 63 pid: 5957 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946856.500392:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:0.0:1783946856.500401:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+63:2364:x1870603507298304:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946856.500413:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946856.500420:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 63 pid: 5957 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.500433:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 63 pid: 5957 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.500454:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946856.500459:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.500467:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.500474:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946856.500508:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+63:2364:x1870603507298304:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 107us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946856.500515:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:1.0:1783946856.503954:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.504053:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507298560 00000100:00100000:3.0:1783946856.504120:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507298560 00010000:00010000:3.0:1783946856.504177:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e0 expref: 63 pid: 7190 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946856.504224:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:3.0:1783946856.504235:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+63:2362:x1870603507298560:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946856.504257:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946856.504266:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e0 expref: 63 pid: 7190 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.504307:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e0 expref: 63 pid: 7190 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.504336:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:3.0:1783946856.504343:0:5942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.504355:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.504481:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.504507:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946856.504569:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+63:2362:x1870603507298560:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 334us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946856.504577:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 84 00010000:00010000:2.0:1783946856.505836:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e0 expref: 62 pid: 7190 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.505877:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beacad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523015552:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946856.509573:0:5958:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.18@tcp) returned -22 from blocking AST (req@00000000142554d8 x1870603523015424) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 61 pid: 5957 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.509606:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8400/0x229d2ec450db815e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721ee expref: 61 pid: 5957 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946856.509627:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beaca300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523015424:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946856.509659:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:2.0:1783946856.509669:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.509680:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.509686:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946856.509754:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783946856.510271:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db8165 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721f5 expref: 62 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.510294:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721f5 expref: 61 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.510303:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:2.0:1783946856.510306:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783946856.510309:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9000, rc 0) 00000100:00100000:2.0:1783946856.510526:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11566:x1870603507298432:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 11000us (11264us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1783946856.510538:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 218 00000100:00100000:1.0:1783946856.514537:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946856.514660:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507298816 00000100:00100000:0.0:1783946856.514689:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507298816 00000100:00100000:0.0:1783946856.514784:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1783946856.514795:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11566:x1870603507298816:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:0.0:1783946856.514819:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946856.514852:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db80bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721c4 expref: 61 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946856.515132:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946856.515138:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946856.515207:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:11566:x1870603507298816:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 414us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946856.515216:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:1.0:1783946856.518292:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946856.518763:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507298944 00000100:00100000:2.0:1783946856.518776:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507298944 00000100:00100000:2.0:1783946856.518861:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:2.0:1783946856.518875:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:11566:x1870603507298944:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:2.0:1783946856.519038:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.519112:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946856.519128:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783946856.519258:0:7190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1783946856.519384:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:11566:x1870603507298944:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 511us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946856.519393:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:1.0:1783946856.522807:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946856.523053:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507299072 00000100:00100000:3.0:1783946856.523244:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507299072 00000100:00100000:3.0:1783946856.523333:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 220 00000100:00100000:3.0:1783946856.523346:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+60:11566:x1870603507299072:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783946856.523437:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946856.523468:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5721fc expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.523544:0:5956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.523580:0:5956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721fc expref: 61 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.523606:0:5956:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.523622:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721fc expref: 61 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.523640:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:3.0:1783946856.523644:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783946856.523648:0:5956:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721fc expref: 61 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946856.523657:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780031200, rc 0) 00000100:00100000:3.0:1783946856.523846:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11566:x1870603507299072:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 502us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946856.523856:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 220 00010000:00010000:0.0:1783946856.720584:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783946856.976681:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783946856.976692:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783946856.976731:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1783946856.976742:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783946856.976940:0:12087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be94f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523015680:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783946856.977493:0:12087:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137927800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946857.005532:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946857.005987:0:12087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be94f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523015680:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783946857.006310:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507299200 00000100:00100000:3.0:1783946857.006319:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507299200 00000100:00100000:3.0:1783946857.006424:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:3.0:1783946857.006438:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11567:x1870603507299200:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783946857.006488:0:5957:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783946857.006653:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11567:x1870603507299200:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 216us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946857.006662:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00080000:0.0:1783946857.007292:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946857.014023:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946857.014537:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507299328 00000100:00100000:3.0:1783946857.014552:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507299328 00000100:00100000:3.0:1783946857.014630:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 222 00000100:00100000:3.0:1783946857.014643:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beaca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11567:x1870603507299328:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783946857.014755:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.014776:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.014791:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015295:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015320:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015333:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015373:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015392:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015400:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946857.015804:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783946857.015825:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946857.015841:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015854:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015861:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015867:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015874:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946857.015877:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015884:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015897:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:3.0:1783946857.015900:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946857.015905:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015910:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8188 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015926:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015932:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015948:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015954:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946857.015957:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015964:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015972:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9137983e1d00) 00010000:00010000:3.0:1783946857.015975:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946857.015978:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.015984:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db818f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.016002:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.016008:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.016014:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.016019:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946857.016723:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.016805:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.016816:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:3.0:1783946857.016819:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783946857.016822:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.016829:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db8196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946857.016927:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beaca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11567:x1870603507299328:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 2282us (2915us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946857.016937:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 222 00000100:00100000:1.0:1783946857.028164:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.028330:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507299584 00000100:00100000:2.0:1783946857.028342:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507299584 00000100:00100000:2.0:1783946857.028414:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:2.0:1783946857.028431:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+61:11567:x1870603507299584:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946857.028532:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946857.028564:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db819d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572203 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.028921:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.028938:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.028951:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946857.028964:0:7190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783946857.029046:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.029054:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.029105:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.029130:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946857.029134:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.029141:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.029155:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:2.0:1783946857.029158:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783946857.029163:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.029169:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.029217:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db819d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572203 expref: 63 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.029228:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:2.0:1783946857.029230:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946857.029233:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db819d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572203 expref: 63 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.029243:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8400, rc 0) 00000100:00100000:2.0:1783946857.029311:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:11567:x1870603507299584:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 887us (1158us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1783946857.029318:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:1.0:1783946857.033819:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.033960:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507299712 00000100:00100000:2.0:1783946857.033986:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507299712 00000100:00100000:2.0:1783946857.034260:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 224 00000100:00100000:2.0:1783946857.034275:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:11567:x1870603507299712:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783946857.034314:0:5958:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783946857.034964:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:11567:x1870603507299712:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 690us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946857.034974:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 224 00000100:00100000:1.0:1783946857.048048:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.048213:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507299968 00000100:00100000:2.0:1783946857.048224:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507299968 00000100:00100000:2.0:1783946857.048288:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 225 00000100:00100000:2.0:1783946857.048298:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:11567:x1870603507299968:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946857.048321:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946857.048324:0:7190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783946857.048351:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030200/0x229d2ec450db8142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721e7 expref: 62 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.048373:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946857.048378:0:7190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946857.048404:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57220a expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783946857.049199:0:7190:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1783946857.049345:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.049360:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.049511:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.049576:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57220a expref: 64 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.049594:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57220a expref: 63 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.049601:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91379793ed00) 00010000:00010000:2.0:1783946857.049604:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783946857.049619:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9c00, rc 0) 00000100:00100000:2.0:1783946857.049698:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+63:11567:x1870603507299968:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1401us (1660us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1783946857.049961:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 225 00000100:00100000:1.0:1783946857.057652:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.059027:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507300224 00000100:00100000:2.0:1783946857.059040:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507300224 00000100:00100000:2.0:1783946857.059167:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 226 00000100:00100000:2.0:1783946857.059178:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+63:11567:x1870603507300224:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783946857.059240:0:5958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946857.059266:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57220a expref: 63 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059287:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91379793ed00) 00010000:00010000:2.0:1783946857.059298:0:5958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946857.059319:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059350:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059361:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059376:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059384:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059391:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059437:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059444:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059451:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059457:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946857.059462:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059470:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059479:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:2.0:1783946857.059488:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946857.059493:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059500:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059511:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059517:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059523:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059529:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946857.059532:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059538:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059546:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8d36f109 (ffff91379793ee00) 00010000:00010000:2.0:1783946857.059549:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783946857.059552:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.059558:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8d36f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946857.059649:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:11567:x1870603507300224:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 472us (2008us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783946857.059662:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 226 00000100:00100000:1.0:1783946857.065582:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946857.065750:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507300352 00000100:00100000:3.0:1783946857.065761:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507300352 00000100:00100000:3.0:1783946857.065825:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 227 00000100:00100000:3.0:1783946857.065835:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+62:11567:x1870603507300352:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783946857.065857:0:5957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946857.065882:0:5957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db81d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572211 expref: -99 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.065919:0:5957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.065933:0:5957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.065946:0:5957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.066369:0:5957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030000/0x229d2ec450db81d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572211 expref: 64 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.066391:0:5957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572211 expref: 63 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.066400:0:5957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:3.0:1783946857.066403:0:5957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783946857.066407:0:5957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030e00, rc 0) 00000100:00100000:3.0:1783946857.066470:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+63:11567:x1870603507300352:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 637us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946857.066478:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 227 00000100:00100000:1.0:1783946857.076786:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.076883:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507300608 00000100:00100000:2.0:1783946857.076893:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507300608 00000100:00100000:2.0:1783946857.076960:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 228 00000100:00100000:2.0:1783946857.076970:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+63:11567:x1870603507300608:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783946857.077128:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.077147:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.077161:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783946857.077339:0:5958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1783946857.077350:0:5958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 460996289522ns, next at 461996286848ns, rc = 0 00000004:00010000:2.0:1783946857.077433:0:5958:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f097b5c4 reply state 00000000af790971 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946857.077444:0:5958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783946857.077556:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+65:11567:x1870603507300608:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 586us (778us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1783946857.077563:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 228 00010000:00010000:3.0:1783946857.083008:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.083036:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.083044:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.083051:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783946857.083057:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.083117:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.083136:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:3.0:1783946857.083154:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783946857.083160:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.083167:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db81e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946857.086892:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.088249:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507300736 00000100:00100000:2.0:1783946857.088265:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507300736 00000100:00100000:2.0:1783946857.088338:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 229 00000100:00100000:2.0:1783946857.088348:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+64:11567:x1870603507300736:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946857.088372:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946857.088416:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572218 expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.088477:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572218 expref: 65 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.088492:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572218 expref: 65 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.088510:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:2.0:1783946857.088514:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783946857.088518:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8400, rc 0) 00000100:00100000:2.0:1783946857.088583:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+65:11567:x1870603507300736:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 235us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946857.088590:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 229 00000100:00100000:1.0:1783946857.093406:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.093553:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507300864 00000100:00100000:2.0:1783946857.093564:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507300864 00000100:00100000:2.0:1783946857.093651:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:2.0:1783946857.093662:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2362:x1870603507300864:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1783946857.093886:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946857.094201:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:2362:x1870603507300864:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 539us (812us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783946857.094213:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:1.0:1783946857.101353:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946857.101491:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507301120 00000100:00100000:0.0:1783946857.101503:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507301120 00000100:00100000:0.0:1783946857.101574:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:0.0:1783946857.101585:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+65:11567:x1870603507301120:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783946857.102036:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+66:11567:x1870603507301120:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 451us (692us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1783946857.102045:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:1.0:1783946857.111681:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.111844:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507301376 00000100:00100000:2.0:1783946857.111854:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507301376 00000100:00100000:2.0:1783946857.111919:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 230 00000100:00100000:2.0:1783946857.111931:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+66:11567:x1870603507301376:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783946857.112055:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+66:11567:x1870603507301376:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 126us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946857.112127:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 230 00000100:00100000:1.0:1783946857.118286:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.118573:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507301504 00000100:00100000:2.0:1783946857.118584:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507301504 00000100:00100000:2.0:1783946857.118656:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 231 00000100:00100000:2.0:1783946857.118667:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+66:11567:x1870603507301504:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946857.118688:0:7190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946857.118710:0:7190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57221f expref: -99 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.118979:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db81f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.118996:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.119008:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946857.119121:0:7190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783946857.119143:0:7190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.119173:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db81f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57221f expref: 68 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.119195:0:7190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db81f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57221f expref: 67 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.119207:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:2.0:1783946857.119346:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783946857.119352:0:7190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9600, rc 0) 00000100:00100000:2.0:1783946857.119742:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+67:11567:x1870603507301504:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1075us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946857.119751:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 231 00000100:00100000:0.0:1783946857.129773:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946857.129975:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507301632 00000100:00100000:1.0:1783946857.129985:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507301632 00000100:00100000:1.0:1783946857.130111:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:1.0:1783946857.130123:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+10:2362:x1870603507301632:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783946857.130144:0:9002:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946857.130166:0:9002:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572226 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783946857.130194:0:9002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54de69, blocks: 0x0 00010000:00010000:1.0:1783946857.130213:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1783946857.130228:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946857.130239:0:9002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572226 expref: 11 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.130282:0:9002:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572226 expref: 11 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.130295:0:9002:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44c00, rc 0) 00000100:00100000:1.0:1783946857.130358:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:2362:x1870603507301632:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 237us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946857.130366:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:1.0:1783946857.139238:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.139361:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507301888 00000100:00100000:2.0:1783946857.139371:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507301888 00000100:00100000:2.0:1783946857.139449:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:2.0:1783946857.139460:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+67:11567:x1870603507301888:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783946857.139625:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+67:11567:x1870603507301888:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 166us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946857.139633:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:3.0:1783946857.157956:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.158151:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507302016 00000100:00100000:2.0:1783946857.158167:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507302016 00000100:00100000:2.0:1783946857.158259:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:2.0:1783946857.158270:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:11567:x1870603507302016:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783946857.158288:0:6942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946857.158307:0:6942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57222d expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.158531:0:6942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572226 expref: 12 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.158540:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946857.158545:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946857.158550:0:6942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 12 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.158605:0:6942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572226 expref: 12 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.158794:0:6942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572226 expref: 12 pid: 9002 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946857.158810:0:6942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beacad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6942:1870603523015808:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946857.158983:0:6942:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ae7480 going to sleep for 11 seconds 00000100:00100000:2.0:1783946857.181263:0:6942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beacad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6942:1870603523015808:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946857.181302:0:6942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 12 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.181336:0:6942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9c00, rc 0) 00000100:00100000:2.0:1783946857.181418:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:11567:x1870603507302016:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 23149us (23477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946857.181429:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:2.0:1783946857.182651:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946857.182738:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507302144 00000100:00100000:3.0:1783946857.182749:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507302144 00010000:00010000:3.0:1783946857.182793:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572226 expref: 12 pid: 9002 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946857.182838:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:3.0:1783946857.182848:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:2361:x1870603507302144:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946857.182864:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946857.182887:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572226 expref: 12 pid: 9002 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.182902:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572226 expref: 12 pid: 9002 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.182928:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db81ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572226 expref: 12 pid: 9002 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.182942:0:5942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946857.182946:0:5942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946857.182955:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 11 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.182981:0:5942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 11 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.183015:0:5942:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 11 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946857.183042:0:5942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5942:1870603523015936:192.168.201.18@tcp:105: 00000100:00100000:3.0:1783946857.183179:0:5942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be84e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946857.191263:0:5942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be847100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5942:1870603523015936:192.168.201.18@tcp:105: 00010000:00010000:2.0:1783946857.191290:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946857.191345:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:2361:x1870603507302144:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 8498us (8701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946857.191357:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:3.0:1783946857.191630:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.193325:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507302272 00000100:00100000:2.0:1783946857.193353:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507302272 00002000:00100000:2.0:1783946857.193587:0:6949:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9137be844a80 x1870603507302272/t0(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:403/0 lens 504/0 e 0 to 0 dl 1783946868 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783946857.193600:0:6949:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be844a80 with x1870603507302272 ext(0->12) 00002000:00010000:2.0:1783946857.193614:0:6949:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be844a80 00000100:00100000:2.0:1783946857.193655:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:2.0:1783946857.193665:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+11:2362:x1870603507302272:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783946857.199765:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:2362:x1870603507302272:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 6090us (8124us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783946857.199781:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00002000:00100000:2.0:1783946857.199794:0:6949:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9137be844a80 x1870603507302272/t4294967320(0) o4->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:403/0 lens 504/448 e 0 to 0 dl 1783946868 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783946857.199803:0:6949:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be844a80 with x1870603507302272 ext(0->12) 00002000:00010000:2.0:1783946857.199809:0:6949:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be844a80 00000100:00100000:3.0:1783946857.211473:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946857.215453:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507302400 00000100:00100000:0.0:1783946857.215471:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507302400 00000100:00100000:1.0:1783946857.226141:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 233 00000100:00100000:1.0:1783946857.226159:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+67:11567:x1870603507302400:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783946857.230370:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1783946857.230388:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1783946857.230428:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1783946857.230449:0:5935:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff913798021b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1783946857.230454:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137989de100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9137980216c0 00000020:00080000:0.0:1783946857.230457:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137989de900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9137a7e9ae00 00000020:00080000:2.0:1783946857.230510:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1783946857.230702:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523016192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783946857.230805:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946857.230874:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946857.230882:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523016064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783946857.230905:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946857.230934:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523016192 00000100:00100000:3.0:1783946857.230940:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523016192 00000100:00100000:3.0:1783946857.231345:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523016064 00000100:00100000:3.0:1783946857.231350:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523016064 00000100:00100000:3.0:1783946857.231375:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783946857.231384:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3447:x1870603523016192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783946857.231516:0:6945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783946857.231520:0:6945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783946857 00002000:00010000:3.0:1783946857.231522:0:6945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783946857.231524:0:6945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783946857 -> 1783946857 00002000:00010000:3.0:1783946857.231535:0:6945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783946857.231579:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3447:x1870603523016192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (773us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1783946857.231587:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783946857.231607:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783946857.231614:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a5f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3449:x1870603523016064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783946857.231630:0:6945:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1783946857.231648:0:6945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.231672:0:6945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572185 expref: 12 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.231681:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1783946857.231686:0:6945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783946857.231691:0:6945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783946857.231855:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1783946857.231912:0:3447:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be9f1f80/2, rc 0, transno 4294967321 00000100:00100000:2.0:1783946857.231919:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523016192:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1783946857.231964:0:6945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.18@tcp remote: 0x330415b06f572185 expref: 12 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.231982:0:6945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f572185 expref: 12 pid: 9002 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946857.231995:0:6945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6945:1870603523016320:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783946857.232427:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946857.232437:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523016448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783946857.232945:0:6945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be84e6c0 going to sleep for 11 seconds 00000004:00080000:0.0:1783946857.234370:0:5935:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1783946857.234406:0:5935:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9137927809c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1783946857.234412:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff913785680000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff913792780a80 00000020:00080000:0.0:1783946857.234416:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff913785680900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91378120b200 00000100:00100000:1.0:1783946857.239243:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946857.239329:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523016448 00000100:00100000:1.0:1783946857.239338:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523016448 00000100:00100000:1.0:1783946857.239409:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783946857.239421:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3447:x1870603523016448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783946857.239456:0:9002:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1783946857.239493:0:9002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a54de68, atime: 0x6a54de68, ctime: 0x6a54de68, blocks: 0x8 00010000:00010000:1.0:1783946857.239502:0:9002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239519:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1783946857.239524:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946857.239546:0:9002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239563:0:9002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239574:0:9002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239582:0:9002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239600:0:9002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783946857.239751:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3447:x1870603523016448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 333us (517us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783946857.239759:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1783946857.239782:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946857.239788:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239797:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946857.239801:0:5944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239810:0:5944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239840:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239847:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e308a6/0x229d2ec450db8214 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.239865:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946857.239867:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946857.239869:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783946857.239904:0:3447:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be7edc00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1783946857.239911:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523016448:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783946857.239953:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1783946857.239991:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783946857.253516:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:11567:x1870603507302400:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 27346us (42038us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946857.253535:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 233 00000100:00100000:3.0:1783946857.263502:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946857.263607:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507302528 00000100:00100000:0.0:1783946857.263617:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507302528 00010000:00010000:0.0:1783946857.263664:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f572185 expref: 13 pid: 9002 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946857.263708:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:0.0:1783946857.263718:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:2362:x1870603507302528:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946857.263746:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946857.263752:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f572185 expref: 13 pid: 9002 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.263766:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f572185 expref: 13 pid: 9002 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.263809:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946857.263814:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946857.263820:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.263830:0:8023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.263851:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946857.263894:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+13:2362:x1870603507302528:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 177us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946857.263901:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00010000:00010000:2.0:1783946857.264127:0:6945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db7fc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.18@tcp remote: 0x330415b06f572185 expref: 12 pid: 9002 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946857.264143:0:6945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6945:1870603523016320:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946857.264164:0:6945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.264185:0:6945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.264191:0:6945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.264199:0:6945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.264205:0:6945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.264225:0:6945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783946857.264411:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a5f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3449:x1870603523016064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32797us (33504us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1783946857.264420:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1783946857.264746:0:3449:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be846d80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1783946857.264753:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523016064:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783946857.265173:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783946857.265182:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.265194:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946857.265199:0:5945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.265209:0:5945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.265229:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.265255:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001137b208/0x229d2ec450db820d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.265278:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946857.265280:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946857.265282:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946857.272454:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.272617:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507302656 00000100:00100000:2.0:1783946857.272629:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507302656 00000100:00100000:2.0:1783946857.272696:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:2.0:1783946857.272715:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+12:2361:x1870603507302656:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1783946857.277256:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1783946857.277283:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1783946857.277712:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507302656:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 4988us (5258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946857.277734:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:2.0:1783946857.281503:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946857.282816:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507302912 00000100:00100000:3.0:1783946857.282832:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507302912 00000100:00100000:2.0:1783946857.283165:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 234 00000100:00100000:2.0:1783946857.283177:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:11567:x1870603507302912:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783946857.283238:0:5956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946857.283266:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db81f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57221f expref: 21 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.283289:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:2.0:1783946857.283294:0:5956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946857.283326:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.283343:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.283353:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783946857.283516:0:5956:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c004163 reply state 0000000030979b4c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946857.283525:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783946857.283638:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:11567:x1870603507302912:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 462us (2146us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1783946857.283645:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 234 00010000:00010000:0.0:1783946857.286838:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.286859:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.286867:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.288260:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946857.288273:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.288284:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.288306:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:0.0:1783946857.288310:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946857.288315:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.288323:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db821b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946857.290331:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946857.290423:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507303040 00000100:00100000:1.0:1783946857.290433:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507303040 00000100:00100000:1.0:1783946857.290513:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1783946857.290524:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507303040:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783946857.290707:0:6944:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783946857.290711:0:6944:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1783946857 -> 1783946856 00002000:00010000:1.0:1783946857.290714:0:6944:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783946856 00002000:00010000:1.0:1783946857.290716:0:6944:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783946857 -> 1783946856 00002000:00010000:1.0:1783946857.290718:0:6944:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783946857.290908:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2361:x1870603507303040:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 385us (586us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1783946857.290934:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:3.0:1783946857.293352:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.293846:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507303296 00000100:00100000:2.0:1783946857.293858:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507303296 00000100:00100000:2.0:1783946857.293965:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 235 00000100:00100000:2.0:1783946857.293977:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:11567:x1870603507303296:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783946857.294127:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.294147:0:7190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572211 expref: 21 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.294157:0:7190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.294202:0:7190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572211 expref: 21 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.294217:0:7190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572211 expref: 21 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946857.294234:0:7190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beac9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523016576:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946857.294338:0:7190:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ae7480 going to sleep for 11 seconds 00000100:00100000:2.0:1783946857.296361:0:7190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beac9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7190:1870603523016576:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783946857.296562:0:7190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946857.297625:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946857.297989:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507303424 00000100:00100000:0.0:1783946857.297998:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507303424 00010000:00010000:0.0:1783946857.298040:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572211 expref: 22 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946857.298112:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:0.0:1783946857.298123:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3532450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:2361:x1870603507303424:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946857.298140:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946857.298148:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572211 expref: 22 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.298161:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572211 expref: 22 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.298182:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030e00/0x229d2ec450db81dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572211 expref: 22 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.298199:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:0.0:1783946857.298205:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.298216:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.298224:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.298687:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946857.298767:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3532450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:2361:x1870603507303424:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 644us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946857.298776:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00010000:00010000:2.0:1783946857.299216:0:7190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.299224:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.299329:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.299344:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.299350:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.299356:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946857.299360:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.299366:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.299377:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:2.0:1783946857.299380:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783946857.299632:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.299641:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db8222 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946857.299855:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:11567:x1870603507303296:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 5877us (6511us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783946857.299865:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 235 00000100:00100000:3.0:1783946857.304751:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946857.304902:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507303552 00000100:00100000:1.0:1783946857.304913:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507303552 00000100:00100000:1.0:1783946857.304973:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:1.0:1783946857.304984:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2361:x1870603507303552:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783946857.305029:0:9002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.305050:0:9002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 8 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.305105:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946857.305111:0:9002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783946857.305117:0:9002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.305156:0:9002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 8 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.305170:0:9002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 8 pid: 6942 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946857.305186:0:9002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9002:1870603523016704:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783946857.305277:0:9002:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137927800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946857.313204:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946857.313848:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507303680 00000100:00100000:0.0:1783946857.313860:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507303680 00010000:00010000:0.0:1783946857.313910:0:8023:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 9 pid: 6942 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946857.313960:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:0.0:1783946857.313972:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2361:x1870603507303680:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946857.313988:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946857.314012:0:8023:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 9 pid: 6942 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.314028:0:8023:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 9 pid: 6942 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.314057:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946857.314117:0:8023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783946857.314126:0:8023:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.314137:0:8023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.314159:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946857.314221:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+9:2361:x1870603507303680:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 251us (1029us total) trans 0 rc 0/0 00010000:00010000:1.0:1783946857.314358:0:9002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8206 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x330415b06f57222d expref: 9 pid: 6942 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946857.314400:0:9002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9002:1870603523016704:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783946857.314422:0:9002:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.314433:0:9002:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.314441:0:9002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.314473:0:9002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.314481:0:9002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.314489:0:9002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.314496:0:9002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946857.314500:0:9002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.314508:0:9002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.314527:0:9002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.314534:0:9002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8229 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946857.314582:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2361:x1870603507303552:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 9600us (9842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946857.314591:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:0.0:1783946857.315928:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:3.0:1783946857.318739:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946857.318974:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507303936 00000100:00100000:0.0:1783946857.318990:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507303936 00000100:00100000:0.0:1783946857.319134:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 236 00000100:00100000:0.0:1783946857.319150:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:11567:x1870603507303936:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783946857.319280:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.319303:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d9 expref: 20 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.319315:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.319528:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d9 expref: 20 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.319546:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d9 expref: 20 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946857.319565:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523016832:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946857.319678:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028780 going to sleep for 11 seconds 00000100:00100000:3.0:1783946857.322411:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946857.322589:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507304064 00000100:00100000:1.0:1783946857.322605:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507304064 00010000:00010000:1.0:1783946857.322663:0:5942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d9 expref: 21 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946857.322859:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:1.0:1783946857.322874:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:2361:x1870603507304064:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946857.322895:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946857.322905:0:5942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d9 expref: 21 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946857.322916:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523016832:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783946857.322930:0:5942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d9 expref: 21 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.322964:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db811f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721d9 expref: 21 pid: 5957 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.326633:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946857.326636:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.326659:0:5942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721fc expref: 20 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.326677:0:5942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.326687:0:5942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.326800:0:5942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.335037:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783946857.335161:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.335190:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.335449:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.335468:0:5958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572218 expref: 21 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.335476:0:5958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.335517:0:5958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572218 expref: 21 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.335534:0:5958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572218 expref: 21 pid: 7190 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946857.335549:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523016960:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783946857.335641:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783946857.335999:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:2361:x1870603507304064:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 13128us (13603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946857.336010:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:3.0:1783946857.340860:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946857.341124:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507304192 00000100:00100000:1.0:1783946857.341133:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507304192 00010000:00010000:1.0:1783946857.341170:0:5943:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572218 expref: 21 pid: 7190 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946857.341205:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:1.0:1783946857.341214:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:2361:x1870603507304192:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946857.341242:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946857.341249:0:5943:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572218 expref: 21 pid: 7190 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.341280:0:5943:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572218 expref: 21 pid: 7190 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.341303:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:1.0:1783946857.341308:0:5943:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.341317:0:5943:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.341325:0:5943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.341343:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946857.341400:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:2361:x1870603507304192:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 187us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946857.341407:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 90 00010000:00010000:0.0:1783946857.342605:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db81ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572218 expref: 20 pid: 7190 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946857.342628:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523016960:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946857.342652:0:5958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.342661:0:5958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.342678:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783946857.342810:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1783946857.343050:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1783946857.343206:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1783946857.343409:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523017088:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783946857.343468:0:5958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946857.343505:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798021840 going to sleep for 11 seconds 00000100:00100000:1.0:1783946857.343828:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523017088 00000100:00100000:1.0:1783946857.343836:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523017088 00000100:00100000:1.0:1783946857.343901:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783946857.343911:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5958:x1870603523017088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783946857.344000:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5958:x1870603523017088:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946857.344008:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783946857.345014:0:5958:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1783946857.345024:0:5958:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1783946857.345046:0:5958:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be9f1f80, transno 4294967321 00000004:00080000:0.0:1783946857.345090:0:5958:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be846d80, transno 4294967322 00000100:00100000:0.0:1783946857.345108:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523017088:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1783946857.345656:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1783946857.345747:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523017216:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783946857.345804:0:5958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946857.345829:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946857.346490:0:5962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523017216 00000100:00100000:1.0:1783946857.346499:0:5962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523017216 00000100:00100000:1.0:1783946857.346560:0:5962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783946857.346571:0:5962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5958:x1870603523017216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783946857.346759:0:5962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5958:x1870603523017216:12345-0@lo:1000:mdt00_002.0 Request processed in 189us (953us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1783946857.346768:0:5962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783946857.347250:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5958:1870603523017216:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783946857.347294:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347305:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347313:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347332:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946857.347337:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347344:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347361:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1d00) 00010000:00010000:0.0:1783946857.347364:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783946857.347369:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347375:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8a00/0x229d2ec450db8237 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347409:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347415:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347420:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347424:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946857.347427:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347432:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347463:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946857.347466:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783946857.347473:0:5958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721fc expref: 23 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347484:0:5958:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721fc expref: 23 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347493:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721fc expref: 23 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.347527:0:5958:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721fc expref: 23 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946857.347541:0:5958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523017344:192.168.201.18@tcp:105: 00000100:00100000:0.0:1783946857.347613:0:5958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9fddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946857.356758:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946857.356869:0:5958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5958:1870603523017344:192.168.201.18@tcp:105: 00000100:00100000:2.0:1783946857.356997:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507304320 00000100:00100000:2.0:1783946857.357005:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507304320 00000100:00100000:3.0:1783946857.357179:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:3.0:1783946857.357191:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:11566:x1870603507304320:12345-192.168.201.18@tcp:49:lfs.0 00000100:00100000:3.0:1783946857.357357:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:11566:x1870603507304320:12345-192.168.201.18@tcp:49:lfs.0 Request processed in 168us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946857.357364:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00010000:00010000:0.0:1783946857.358001:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.358012:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db817a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358121:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358136:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358147:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358157:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358163:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358170:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358176:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946857.358180:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358187:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358201:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:1.0:1783946857.358203:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946857.358207:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358240:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44c00/0x229d2ec450db823e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358251:0:5958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358257:0:5958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358262:0:5958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358267:0:5958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783946857.358270:0:5958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358275:0:5958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358283:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:1.0:1783946857.358285:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783946857.358288:0:5958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946857.358293:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8230 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946857.358438:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:11567:x1870603507303936:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 39291us (39715us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1783946857.358448:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 236 00000020:00080000:1.0:1783946857.358459:0:5958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783946857.360366:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783946857.360375:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783946857.362664:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1783946857.362683:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783946857.363827:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946857.364867:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507304576 00000100:00100000:0.0:1783946857.364962:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507304576 00000100:00100000:0.0:1783946857.365040:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 237 00000100:00100000:0.0:1783946857.365051:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+23:11566:x1870603507304576:12345-192.168.201.18@tcp:58:lfs.0 00000100:00100000:3.0:1783946857.365463:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946857.365496:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507304832 00000100:00100000:3.0:1783946857.365501:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507304832 00000100:00100000:3.0:1783946857.365537:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:3.0:1783946857.365546:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a07e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+24:11567:x1870603507304832:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783946857.365795:0:5959:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783946857.365828:0:5959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1783946857.365873:0:5959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783946857.367353:0:5957:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1783946857.367464:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:11566:x1870603507304576:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 2409us (4438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946857.367473:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 237 00010000:00010000:3.0:1783946857.371739:0:5959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.371753:0:5959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.371764:0:5959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.371770:0:5959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.371776:0:5959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.371808:0:5959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783946857.371939:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a07e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+25:11567:x1870603507304832:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 6390us (6473us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1783946857.371949:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000020:00080000:3.0:1783946857.371955:0:5959:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783946857.374861:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783946857.374877:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.374888:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946857.374893:0:5944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.374905:0:5944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.374927:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9137983e1400) 00010000:00010000:0.0:1783946857.374930:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783946857.374936:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.374942:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780030600/0x229d2ec450db8245 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.374967:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946857.374969:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946857.374971:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946857.419277:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.419393:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507304960 00000100:00100000:2.0:1783946857.419403:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507304960 00000100:00100000:2.0:1783946857.419471:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 238 00000100:00100000:2.0:1783946857.419482:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+25:11569:x1870603507304960:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946857.419522:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946857.419546:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db824c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572234 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419613:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419629:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419640:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419654:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419662:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419669:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419760:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419772:0:5956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721f5 expref: 26 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419780:0:5956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419817:0:5956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721f5 expref: 26 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946857.419838:0:5956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721f5 expref: 26 pid: 5958 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946857.419851:0:5956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beac9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523017472:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783946857.421035:0:5956:0:(client.c:2702:ptlrpc_set_wait()) set ffff913790ae7480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946857.439842:0:5956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beac9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5956:1870603523017472:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783946857.439894:0:5956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946857.440607:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946857.440686:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507305216 00000100:00100000:2.0:1783946857.440698:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507305216 00000100:00100000:2.0:1783946857.440830:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:2.0:1783946857.440841:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+27:5910:x1870603507305216:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783946857.443310:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:5910:x1870603507305216:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 2457us (2700us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1783946857.443329:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:2.0:1783946857.449857:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946857.450141:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507305344 00000100:00100000:3.0:1783946857.450152:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507305344 00010000:00010000:3.0:1783946857.450203:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721f5 expref: 28 pid: 5958 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946857.450251:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:3.0:1783946857.450263:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:2362:x1870603507305344:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946857.450294:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946857.450303:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721f5 expref: 28 pid: 5958 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.450317:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721f5 expref: 28 pid: 5958 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.450341:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db816c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5721f5 expref: 28 pid: 5958 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.450360:0:5941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:3.0:1783946857.450364:0:5941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.450373:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.450380:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946857.450585:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946857.450649:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+27:2362:x1870603507305344:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 388us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946857.450659:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 91 00010000:00010000:0.0:1783946857.452328:0:5956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452345:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946857.452405:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783946857.452409:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946857.452429:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452446:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452456:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452462:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452468:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452474:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946857.452480:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452487:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452501:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:0.0:1783946857.452521:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946857.452525:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452532:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db8253 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452549:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452556:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452562:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452568:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783946857.452573:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452579:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452587:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91379793ee00) 00010000:00010000:0.0:1783946857.452590:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783946857.452593:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452600:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db825a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452642:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db824c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572234 expref: 27 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452670:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572234 expref: 26 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946857.452678:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946857.452680:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946857.452683:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8400, rc 0) 00000100:00100000:0.0:1783946857.452832:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:11569:x1870603507304960:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 33350us (33564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946857.452843:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 238 00010000:00010000:0.0:1783946857.747422:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946858.352944:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946858.353134:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507305472 00000100:00100000:3.0:1783946858.353148:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507305472 00000100:00100000:3.0:1783946858.353432:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 307 00000100:00100000:3.0:1783946858.353448:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507305472:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946858.353753:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507305472:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 308us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946858.353763:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 307 00000100:00100000:2.0:1783946858.358688:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946858.358763:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946858.358799:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946858.359000:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507305728 00000100:00100000:1.0:1783946858.359019:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507305728 00000100:00100000:1.0:1783946858.359153:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507305856 00000100:00100000:1.0:1783946858.359158:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507305856 00000100:00100000:1.0:1783946858.359198:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:1.0:1783946858.359207:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507305728:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946858.359380:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507305600 00000100:00100000:1.0:1783946858.359382:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507305728:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 174us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946858.359394:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507305600 00000100:00100000:1.0:1783946858.359401:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:1.0:1783946858.359435:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:1.0:1783946858.359445:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507305856:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946858.359473:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 180 00000100:00100000:2.0:1783946858.359636:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946858.359654:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507305856:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 207us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946858.359664:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00080000:1.0:1783946858.359692:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946858.359713:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507305984 00000100:00100000:1.0:1783946858.359718:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507305984 00000100:00100000:3.0:1783946858.363757:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:2362:x1870603507305600:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946858.363807:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 181 00000100:00100000:1.0:1783946858.363837:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507305984:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946858.363891:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:2362:x1870603507305600:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 159us (5217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946858.363902:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 180 00000100:00100000:1.0:1783946858.363935:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507305984:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 112us (4296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946858.363945:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 181 00000100:00080000:1.0:1783946858.363992:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1783946858.386680:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783946858.386704:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783946858.386739:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783946858.386747:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783946858.386922:0:12087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beacb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523017600:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783946858.392615:0:12087:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137beb13480 going to sleep for 11 seconds 00000100:00100000:1.0:1783946858.406787:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946858.406849:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507306112 00000100:00100000:1.0:1783946858.406862:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507306112 00000100:00100000:1.0:1783946858.406931:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 239 00000100:00100000:1.0:1783946858.406943:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+27:11580:x1870603507306112:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783946858.406982:0:7190:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783946858.408609:0:12087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beacb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12087:1870603523017600:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783946858.408723:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:11580:x1870603507306112:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 1781us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946858.408735:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 239 00000100:00100000:3.0:1783946858.438468:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946858.438873:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507306368 00000100:00100000:0.0:1783946858.438887:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507306368 00000100:00100000:0.0:1783946858.438973:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 240 00000100:00100000:0.0:1783946858.439152:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+26:11580:x1870603507306368:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783946858.439189:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946858.439224:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8268 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57223b expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946858.439374:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db826f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946858.439394:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db826f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946858.439409:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db826f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946858.439442:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783946858.443386:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9600/0x229d2ec450db8268 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57223b expref: 29 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946858.443437:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db826f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57223b expref: 28 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946858.443456:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946858.443460:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783946858.443465:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8e00, rc 0) 00000100:00100000:0.0:1783946858.443580:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:11580:x1870603507306368:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 4595us (5126us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1783946858.443593:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 240 00000100:00100000:0.0:1783946858.465672:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946858.465888:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507306624 00000100:00100000:2.0:1783946858.465901:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507306624 00000100:00100000:2.0:1783946858.465976:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 241 00000100:00100000:2.0:1783946858.465988:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:11580:x1870603507306624:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783946858.466135:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.466158:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.466171:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.466375:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.466384:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.466392:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.466398:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946858.466403:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.466411:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.466426:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:2.0:1783946858.466437:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783946858.466444:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.466450:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db827d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946858.466604:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:11580:x1870603507306624:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 616us (945us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1783946858.466612:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 241 00000040:00080000:2.0:1783946858.466988:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783946858.466994:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783946858.467515:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783946858.467524:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783946858.482325:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946858.482430:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507306752 00000100:00100000:0.0:1783946858.482442:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507306752 00000100:00100000:0.0:1783946858.482522:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:0.0:1783946858.482536:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:2361:x1870603507306752:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946858.482553:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946858.482579:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8e00/0x229d2ec450db826f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57223b expref: 29 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946858.482597:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:0.0:1783946858.482602:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946858.482674:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:2361:x1870603507306752:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 141us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946858.482704:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:0.0:1783946858.488534:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946858.490307:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507307008 00000100:00100000:3.0:1783946858.490332:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507307008 00000100:00100000:3.0:1783946858.490410:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:3.0:1783946858.490419:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+28:11580:x1870603507307008:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783946858.490635:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:11580:x1870603507307008:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 217us (2111us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783946858.490643:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00000040:00080000:2.0:1783946858.621817:0:12896:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783946858.621828:0:12896:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783946858.621870:0:12896:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783946858.621877:0:12896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783946858.777456:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946858.813196:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946858.813289:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507307264 00000100:00100000:2.0:1783946858.813302:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507307264 00000100:00100000:2.0:1783946858.813374:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 242 00000100:00100000:2.0:1783946858.813385:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+29:11593:x1870603507307264:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783946858.813416:0:5958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946858.813444:0:5958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db8284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572242 expref: -99 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.813770:0:5958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db828b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.813790:0:5958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db828b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.813816:0:5958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db828b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946858.813831:0:5958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783946858.813970:0:5958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9a00/0x229d2ec450db8284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572242 expref: 32 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.813991:0:5958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db828b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572242 expref: 31 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.814001:0:5958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:2.0:1783946858.814004:0:5958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783946858.814008:0:5958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8600, rc 0) 00000100:00100000:2.0:1783946858.814135:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:11593:x1870603507307264:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 751us (951us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1783946858.814145:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 242 00000100:00100000:3.0:1783946858.819901:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946858.820823:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507307392 00000100:00100000:2.0:1783946858.820838:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507307392 00000100:00100000:2.0:1783946858.820911:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 243 00000100:00100000:2.0:1783946858.820923:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:11593:x1870603507307392:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1783946858.821018:0:7190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.821049:0:7190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.821094:0:7190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.821167:0:7190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.821175:0:7190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.821183:0:7190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.821190:0:7190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783946858.821195:0:7190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.821203:0:7190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.821218:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:2.0:1783946858.821222:0:7190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783946858.821227:0:7190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946858.821234:0:7190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9e00/0x229d2ec450db8299 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946858.821322:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+31:11593:x1870603507307392:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 401us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946858.821331:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 243 00000100:00100000:3.0:1783946858.899592:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946858.902609:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507307520 00000100:00100000:1.0:1783946858.902632:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507307520 00000100:00100000:1.0:1783946858.902726:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:1.0:1783946858.902738:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507307520:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:1.0:1783946858.902766:0:6944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946858.902806:0:6944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db82a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572249 expref: -99 pid: 6944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783946858.902842:0:6944:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a54de68, atime: 0x6a54de68, ctime: 0x6a54de68, blocks: 0x8 00010000:00010000:1.0:1783946858.902871:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1783946858.902876:0:6944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946858.902890:0:6944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db82a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572249 expref: 8 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946858.902912:0:6944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db82a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572249 expref: 8 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946858.902945:0:6944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44a00, rc 0) 00000100:00100000:1.0:1783946858.903032:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2363:x1870603507307520:12345-192.168.201.18@tcp:101:cat.0 Request processed in 296us (3456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946858.903053:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:1.0:1783946858.907677:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946858.907730:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507307648 00000100:00100000:1.0:1783946858.907744:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507307648 00002000:00100000:1.0:1783946858.907808:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9137be7eca80 x1870603507307648/t0(0) o3->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:404/0 lens 488/0 e 0 to 0 dl 1783946869 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783946858.907821:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be7eca80 with x1870603507307648 ext(0->4095) 00002000:00010000:1.0:1783946858.907828:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be7eca80 00000100:00100000:1.0:1783946858.907863:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:1.0:1783946858.907874:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2364:x1870603507307648:12345-192.168.201.18@tcp:3:cat.0 00000100:00100000:1.0:1783946858.908169:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+8:2364:x1870603507307648:12345-192.168.201.18@tcp:3:cat.0 Request processed in 295us (506us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783946858.908179:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00002000:00100000:1.0:1783946858.908187:0:6948:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9137be7eca80 x1870603507307648/t0(0) o3->c2268401-da9f-4e1e-8a1c-9473caf67cba@192.168.201.18@tcp:404/0 lens 488/4536 e 0 to 0 dl 1783946869 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783946858.908195:0:6948:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9137be7eca80 with x1870603507307648 ext(0->4095) 00002000:00010000:1.0:1783946858.908199:0:6948:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9137be7eca80 00000040:00080000:2.0:1783946859.473556:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783946859.473566:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783946859.473591:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783946859.473611:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783946859.796807:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946860.432532:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523017728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946860.432636:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946860.434444:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523017728 00000100:00100000:0.0:1783946860.434461:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523017728 00000100:00100000:0.0:1783946860.434575:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783946860.434591:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be4cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603523017728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946860.434632:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1783946860.434732:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be4cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603523017728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946860.434740:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783946860.434851:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523017728:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783946860.435116:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783946860.816291:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946861.459527:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523017856:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.459623:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946861.459805:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beacb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603523018368:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.459837:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946861.459970:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783946861.459978:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beaca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523018240:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.460021:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946861.460056:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beacb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523017984:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.460111:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946861.460129:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523018496:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.460154:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946861.460174:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946861.460179:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523018112:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.460200:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946861.460238:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523017856 00000100:00100000:2.0:1783946861.460247:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523017856 00000100:00100000:2.0:1783946861.460299:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783946861.460309:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603523017856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.460361:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603523017856:12345-0@lo:400:kworker.0 Request processed in 52us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946861.460367:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783946861.460398:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523018368 00000100:00100000:2.0:1783946861.460402:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523018368 00000100:00100000:2.0:1783946861.460435:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523017984 00000100:00100000:2.0:1783946861.460447:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523017984 00000100:00100000:2.0:1783946861.460460:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523018112 00000100:00100000:2.0:1783946861.460462:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523018112 00000100:00100000:2.0:1783946861.460478:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783946861.460485:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603523018368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.460518:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603523018368:12345-0@lo:400:kworker.0 Request processed in 34us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946861.460524:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783946861.460535:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783946861.460541:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523017984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.460573:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523017984:12345-0@lo:400:kworker.0 Request processed in 32us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946861.460579:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783946861.460591:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783946861.460596:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523018112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.460622:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523018112:12345-0@lo:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946861.460841:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523018624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946861.461019:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946861.461078:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523018624 00000100:00100000:3.0:1783946861.461083:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523018624 00000100:00100000:3.0:1783946861.461119:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783946861.461127:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3448:x1870603523018624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783946861.461153:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42381888 pending 28672 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946861.461193:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3448:x1870603523018624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946861.461199:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783946861.461253:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523018624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946861.461772:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783946861.461804:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523018240 00000100:00100000:2.0:1783946861.461809:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523018240 00000100:00100000:2.0:1783946861.462711:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523018496 00000100:00100000:2.0:1783946861.462719:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523018496 00000100:00100000:0.0:1783946861.469623:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783946861.469663:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3450:x1870603523018240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946861.469777:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3450:x1870603523018240:12345-0@lo:400:kworker.0 Request processed in 126us (9755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946861.469785:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783946861.469812:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783946861.469820:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bde8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3447:x1870603523018496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946861.469850:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bde8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3447:x1870603523018496:12345-0@lo:400:kworker.0 Request processed in 32us (9695us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946861.469856:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783946861.472245:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beaca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523018240:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.472267:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523017856:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.472281:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beacb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603523018368:0@lo:400:kworker.0 00000100:00080000:2.0:1783946861.472324:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783946861.472349:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946861.472382:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523018112:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.472396:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beacb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523017984:0@lo:400:kworker.0 00000100:00100000:2.0:1783946861.472409:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523018496:0@lo:400:kworker.0 00010000:00010000:0.0:1783946861.840260:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783946861.972143:0:8015:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1783946861.972169:0:8015:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:0.0:1783946862.864607:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783946862.995103:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1783946862.995136:0:6938:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1783946863.000156:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1783946863.000199:0:5935:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff913798021d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1783946863.000217:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137989ded00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91379838f0c0 00000020:00080000:1.0:1783946863.000221:0:5935:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9137989dee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9137be69d400 00000020:00080000:1.0:1783946863.000243:0:5935:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1783946863.001866:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1783946863.001994:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1783946863.479876:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946863.480123:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946863.480159:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946863.480178:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946863.480202:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946863.480269:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507307776 00000100:00100000:0.0:1783946863.480282:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507307776 00000100:00100000:0.0:1783946863.480345:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 309 00000100:00100000:0.0:1783946863.480357:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507307776:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946863.480452:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507307776:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946863.480461:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 309 00000100:00100000:0.0:1783946863.480506:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507308032 00000100:00100000:0.0:1783946863.480510:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507308032 00000100:00100000:0.0:1783946863.480555:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507308160 00000100:00100000:0.0:1783946863.480558:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507308160 00000100:00100000:0.0:1783946863.480602:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:0.0:1783946863.480610:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507308032:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946863.480646:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507308032:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 36us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946863.480653:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:0.0:1783946863.480665:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:0.0:1783946863.480672:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507308160:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946863.480700:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507308160:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946863.480707:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00080000:0.0:1783946863.480877:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783946863.480883:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946863.500799:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507307904 00000100:00100000:2.0:1783946863.500822:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507307904 00000100:00100000:2.0:1783946863.500920:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507308288 00000100:00100000:2.0:1783946863.500925:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507308288 00000100:00100000:2.0:1783946863.500976:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 185 00000100:00100000:2.0:1783946863.500989:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2361:x1870603507307904:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946863.501135:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2361:x1870603507307904:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 149us (21275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946863.501145:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 185 00000100:00100000:2.0:1783946863.501174:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 186 00000100:00100000:2.0:1783946863.501183:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507308288:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946863.501211:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507308288:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 30us (21008us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946863.501218:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 186 00000100:00080000:0.0:1783946863.501309:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783946863.888279:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946864.914017:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946865.554148:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523018752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946865.554258:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946865.554554:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523018752 00000100:00100000:0.0:1783946865.554565:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523018752 00000100:00100000:0.0:1783946865.554654:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783946865.554666:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523018752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946865.554708:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1783946865.554766:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523018752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946865.554774:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1783946865.554911:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946865.554959:0:3449:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1783946865.554967:0:3449:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1783946865.555014:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523018752:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783946865.937142:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946866.576759:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946866.576797:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137bdd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523018880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946866.576919:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946866.577155:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523018880 00000100:00100000:3.0:1783946866.577165:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523018880 00000100:00100000:3.0:1783946866.577247:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783946866.577259:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523018880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783946866.577301:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42353216 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946866.577352:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523018880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946866.577359:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783946866.577528:0:3449:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1783946866.577535:0:3449:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1783946866.577567:0:3449:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be7edc00, transno 4294967310 00000100:00100000:0.0:1783946866.577589:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137bdd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523018880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946866.578677:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523019008:0@lo:400:kworker.0 00000100:00100000:2.0:1783946866.578777:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946866.578812:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523019392:0@lo:400:kworker.0 00000100:00100000:0.0:1783946866.578834:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603523019136:0@lo:400:kworker.0 00000100:00100000:3.0:1783946866.578866:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946866.578886:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783946866.581356:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783946866.581398:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523019520:0@lo:400:kworker.0 00000100:00100000:1.0:1783946866.581419:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523019008 00000100:00100000:1.0:1783946866.581443:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523019008 00000100:00100000:2.0:1783946866.581498:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946866.581519:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1783946866.581533:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523019008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946866.581565:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523019136 00000100:00100000:2.0:1783946866.581570:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523019136 00000100:00100000:2.0:1783946866.581605:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523019520 00000100:00100000:2.0:1783946866.581608:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523019520 00000100:00100000:2.0:1783946866.581641:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1783946866.581649:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603523019136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946866.581940:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603523019136:12345-0@lo:400:kworker.0 Request processed in 291us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946866.581948:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1783946866.581969:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1783946866.581975:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523019520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946866.582009:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523019520:12345-0@lo:400:kworker.0 Request processed in 34us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946866.582015:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:2.0:1783946866.582037:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946866.582097:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523019520:0@lo:400:kworker.0 00000100:00100000:2.0:1783946866.582146:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523019392 00000100:00100000:2.0:1783946866.582151:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523019392 00000100:00100000:2.0:1783946866.582355:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783946866.582364:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523019392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946866.582404:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523019392:12345-0@lo:400:kworker.0 Request processed in 42us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946866.582411:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783946866.582480:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523019264:0@lo:400:kworker.0 00000100:00100000:2.0:1783946866.582513:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946866.582545:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523019264 00000100:00100000:2.0:1783946866.582548:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523019264 00000100:00100000:2.0:1783946866.582576:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783946866.582582:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523019264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946866.582616:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523019264:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946866.582622:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:2.0:1783946866.582639:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946866.582657:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523019264:0@lo:400:kworker.0 00000100:00100000:1.0:1783946866.582697:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a079ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523019008:12345-0@lo:400:kworker.0 Request processed in 1166us (3920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946866.582706:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1783946866.582748:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523019008:0@lo:400:kworker.0 00000100:00100000:0.0:1783946866.583165:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603523019136:0@lo:400:kworker.0 00000100:00100000:3.0:1783946866.586706:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523019392:0@lo:400:kworker.0 00010000:00010000:0.0:1783946866.960307:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946867.984259:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946868.592380:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946868.592434:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946868.592486:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946868.592664:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507308416 00000100:00100000:2.0:1783946868.592676:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507308416 00000100:00100000:2.0:1783946868.592749:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 311 00000100:00100000:2.0:1783946868.592760:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507308416:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946868.592850:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507308416:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 92us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946868.592857:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 311 00000100:00100000:1.0:1783946868.593032:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507308672 00000100:00100000:3.0:1783946868.593266:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507308928 00000100:00100000:0.0:1783946868.593328:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946868.593354:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946868.593376:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507308800 00000100:00100000:0.0:1783946868.593380:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507308800 00000100:00100000:3.0:1783946868.593413:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507308928 00000100:00100000:0.0:1783946868.593426:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:0.0:1783946868.593434:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507308800:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946868.593443:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507308544 00000100:00100000:3.0:1783946868.593453:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507308544 00000100:00100000:0.0:1783946868.593474:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507308800:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 41us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946868.593476:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 190 00000100:00100000:0.0:1783946868.593481:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:3.0:1783946868.593483:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507308928:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946868.593514:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2361:x1870603507308928:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 32us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946868.593521:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 190 00000100:00100000:3.0:1783946868.593539:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00100000:3.0:1783946868.593545:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2361:x1870603507308544:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:2.0:1783946868.593622:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783946868.593628:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946868.593765:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507308672 00000100:00100000:1.0:1783946868.593811:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:1.0:1783946868.593819:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507308672:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:2.0:1783946868.593884:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946868.594147:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2361:x1870603507308544:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 601us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946868.594154:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00100000:1.0:1783946868.597672:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2361:x1870603507308672:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 3838us (5221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946868.597691:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 93 00010000:00010000:0.0:1783946869.008600:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783946869.141513:0:5935:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1783946869.141579:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1783946869.141589:0:5988:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1783946869.712325:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783946869.712338:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783946869.712474:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1783946869.712484:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783946870.032365:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946870.672660:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523019648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946870.672831:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946870.672992:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523019648 00000100:00100000:2.0:1783946870.673003:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523019648 00000100:00100000:2.0:1783946870.673103:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783946870.673115:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523019648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783946870.673154:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:2.0:1783946870.673212:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523019648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946870.673238:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783946870.673294:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523019648:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783946870.673368:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783946871.056336:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946871.696533:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523019904:0@lo:400:kworker.0 00000100:00100000:2.0:1783946871.696643:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946871.696663:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523020032:0@lo:400:kworker.0 00000100:00100000:0.0:1783946871.696740:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946871.696773:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523019904 00000100:00100000:2.0:1783946871.696783:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523019904 00000100:00100000:0.0:1783946871.696935:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783946871.696943:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603523020416:0@lo:400:kworker.0 00000100:00100000:0.0:1783946871.696969:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946871.697003:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523020032 00000100:00100000:0.0:1783946871.697009:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523020032 00000100:00100000:0.0:1783946871.697053:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523020416 00000100:00100000:0.0:1783946871.697056:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523020416 00000100:00100000:0.0:1783946871.697120:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783946871.697130:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523020032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946871.697179:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523020032:12345-0@lo:400:kworker.0 Request processed in 50us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946871.697202:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783946871.697219:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783946871.697224:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603523020416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946871.697250:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3450:x1870603523020416:12345-0@lo:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946871.697255:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783946871.697291:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3450:1870603523020416:0@lo:400:kworker.0 00000100:00100000:0.0:1783946871.697301:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523020032:0@lo:400:kworker.0 00000100:00100000:0.0:1783946871.697354:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523020160:0@lo:400:kworker.0 00000100:00100000:0.0:1783946871.697378:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946871.697395:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783946871.697402:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523020288:0@lo:400:kworker.0 00000100:00100000:0.0:1783946871.697425:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946871.697463:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523020288 00000100:00100000:0.0:1783946871.697468:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523020288 00000100:00080000:3.0:1783946871.697481:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946871.697510:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523020160 00000100:00100000:0.0:1783946871.697511:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783946871.697519:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523020160 00000100:00100000:0.0:1783946871.697526:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523020288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946871.697579:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1783946871.697587:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1783946871.697593:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523020288:12345-0@lo:400:kworker.0 Request processed in 69us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946871.697600:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523020160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946871.697603:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603523019904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946871.697622:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783946871.697666:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523020288:0@lo:400:kworker.0 00000100:00100000:2.0:1783946871.697676:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603523019904:12345-0@lo:400:kworker.0 Request processed in 78us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946871.697684:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1783946871.697701:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523019776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946871.697742:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946871.697753:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523019904:0@lo:400:kworker.0 00000100:00080000:2.0:1783946871.697792:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946871.697809:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523019776 00000100:00100000:0.0:1783946871.697816:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523019776 00000100:00100000:0.0:1783946871.697867:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783946871.697873:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523019776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783946871.697901:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42353216 pending 0 free 3923668992 avail 3692146688 00000100:00080000:2.0:1783946871.697943:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783946871.698191:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523019776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 316us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946871.698200:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783946871.698314:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523019776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946871.700511:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523020160:12345-0@lo:400:kworker.0 Request processed in 2913us (3120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946871.700530:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783946871.700607:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523020160:0@lo:400:kworker.0 00010000:00010000:0.0:1783946872.080223:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946873.104307:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946873.711949:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946873.712003:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946873.712009:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507309184 00000100:00100000:0.0:1783946873.712018:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507309184 00000100:00100000:2.0:1783946873.712044:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00080000:1.0:1783946873.712100:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946873.712132:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507309056 00000100:00100000:2.0:1783946873.712144:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946873.712147:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507309056 00000100:00100000:0.0:1783946873.712154:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:0.0:1783946873.712177:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2361:x1870603507309184:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946873.712208:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946873.712219:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 313 00000100:00100000:3.0:1783946873.712232:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507309056:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946873.712244:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507309312 00000100:00100000:2.0:1783946873.712251:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507309312 00000100:00100000:0.0:1783946873.712277:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2361:x1870603507309184:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946873.712287:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:2.0:1783946873.712297:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507309440 00000100:00100000:3.0:1783946873.712304:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507309056:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 68us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946873.712304:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507309440 00000100:00100000:0.0:1783946873.712308:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507309568 00000100:00100000:0.0:1783946873.712316:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507309568 00000100:00100000:3.0:1783946873.712324:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 313 00000100:00100000:2.0:1783946873.712343:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:2.0:1783946873.712356:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507309312:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946873.712364:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:0.0:1783946873.712367:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 196 00000100:00100000:1.0:1783946873.712379:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507309440:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946873.712379:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507309568:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946873.712418:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507309312:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 64us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946873.712430:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:1.0:1783946873.712436:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2361:x1870603507309440:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 48us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946873.712436:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507309568:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 45us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946873.712446:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:0.0:1783946873.712446:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 196 00000100:00080000:1.0:1783946873.712474:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783946873.712479:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783946873.712484:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783946874.128325:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946875.152224:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946875.792372:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be94d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523020544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946875.792460:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946875.792521:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523020544 00000100:00100000:0.0:1783946875.792531:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523020544 00000100:00100000:0.0:1783946875.792598:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783946875.792608:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523020544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946875.792637:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1783946875.792688:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523020544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946875.792695:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1783946875.792766:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946875.792820:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be94d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523020544:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783946876.176221:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946876.816624:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946876.816649:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523020672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946876.816719:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946876.816875:0:6947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523020672 00000100:00100000:3.0:1783946876.816882:0:6947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523020672 00000100:00100000:3.0:1783946876.816940:0:6947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1783946876.816949:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783946876.817014:0:6947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523020672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783946876.817042:0:6947:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42353216 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946876.817125:0:6947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523020672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946876.817133:0:6947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783946876.817223:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523020672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946876.818935:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be94dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523020928:0@lo:400:kworker.0 00000100:00100000:2.0:1783946876.818940:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be94ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523020800:0@lo:400:kworker.0 00000100:00100000:0.0:1783946876.818987:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523021184:0@lo:400:kworker.0 00000100:00100000:2.0:1783946876.819005:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946876.819009:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946876.819032:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946876.819049:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523021312:0@lo:400:kworker.0 00000100:00100000:3.0:1783946876.819090:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be94d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523021056:0@lo:400:kworker.0 00000100:00100000:2.0:1783946876.819144:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946876.819165:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523020928 00000100:00100000:1.0:1783946876.819173:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523020928 00000100:00100000:3.0:1783946876.819180:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946876.819204:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523020800 00000100:00100000:2.0:1783946876.819209:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523020800 00000100:00100000:1.0:1783946876.819222:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523021312 00000100:00100000:1.0:1783946876.819229:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523021312 00000100:00100000:3.0:1783946876.819235:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523021056 00000100:00100000:3.0:1783946876.819241:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523021056 00000100:00100000:2.0:1783946876.819250:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1783946876.819261:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603523020800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946876.819268:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783946876.819275:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1783946876.819281:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523020928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946876.819288:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523021312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946876.819312:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3449:x1870603523020800:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946876.819334:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1783946876.819348:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523021312:12345-0@lo:400:kworker.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946876.819353:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523020928:12345-0@lo:400:kworker.0 Request processed in 74us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946876.819360:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1783946876.819383:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1783946876.819406:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523021312:0@lo:400:kworker.0 00000100:00100000:1.0:1783946876.819408:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783946876.819422:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523021056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946876.819429:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be94ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523020800:0@lo:400:kworker.0 00000100:00100000:0.0:1783946876.819444:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523021184 00000100:00100000:0.0:1783946876.819449:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523021184 00000100:00100000:1.0:1783946876.819469:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523021056:12345-0@lo:400:kworker.0 Request processed in 49us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946876.819477:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783946876.819489:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783946876.819499:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be94d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523021056:0@lo:400:kworker.0 00000100:00100000:0.0:1783946876.819500:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523021184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946876.819518:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be94dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523020928:0@lo:400:kworker.0 00000100:00080000:2.0:1783946876.819539:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946876.819557:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523021184:12345-0@lo:400:kworker.0 Request processed in 60us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946876.819565:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783946876.819593:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523021184:0@lo:400:kworker.0 00010000:00010000:0.0:1783946877.200926:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946878.224213:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946878.833392:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946878.833447:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946878.833524:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946878.833527:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507309824 00000100:00100000:0.0:1783946878.833537:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507309824 00000100:00100000:2.0:1783946878.833546:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507309696 00000100:00100000:2.0:1783946878.833553:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507309696 00000100:00100000:1.0:1783946878.833594:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507309952 00000100:00100000:1.0:1783946878.833601:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507309952 00000100:00100000:2.0:1783946878.833616:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 315 00000100:00100000:0.0:1783946878.833627:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 200 00000100:00100000:2.0:1783946878.833632:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507309696:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946878.833645:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:0.0:1783946878.833646:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2362:x1870603507309824:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783946878.833655:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507309952:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946878.833718:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507309696:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946878.833726:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 315 00000100:00100000:0.0:1783946878.833747:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2362:x1870603507309824:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946878.833759:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 200 00000100:00100000:1.0:1783946878.833781:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2362:x1870603507309952:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 128us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946878.833789:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00080000:3.0:1783946878.834127:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783946878.834132:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946878.834961:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946878.835006:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946878.835042:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507310208 00000100:00100000:2.0:1783946878.835101:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507310080 00000100:00100000:2.0:1783946878.835107:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507310080 00000100:00100000:1.0:1783946878.835118:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507310208 00000100:00100000:2.0:1783946878.835176:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:2.0:1783946878.835184:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2360:x1870603507310080:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:2.0:1783946878.835219:0:6945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db75aa 00000100:00100000:1.0:1783946878.835222:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00080000:2.0:1783946878.835234:0:6945:0:(import.c:65:import_set_state_nolock()) ffff9137be50b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783946878.835234:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507310208:12345-192.168.201.18@tcp:400:kworker.0 00000001:00000004:2.0:1783946878.835303:0:6945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1783946878.835309:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:2362:x1870603507310208:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 75us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946878.835319:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 201 00010000:00010000:0.0:1783946878.835348:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946878.835471:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+2:2360:x1870603507310080:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 286us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946878.835480:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00080000:3.0:1783946878.835542:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783946878.835546:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783946879.248238:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783946879.952303:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783946879.952326:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783946879.952901:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1783946879.952916:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783946880.272641:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946880.916832:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523021440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946880.916931:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946880.917157:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523021440 00000100:00100000:0.0:1783946880.917167:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523021440 00000100:00100000:0.0:1783946880.917260:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783946880.917272:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523021440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946880.917311:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1783946880.917387:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523021440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946880.917395:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1783946880.917460:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946880.917546:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523021440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783946881.296300:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946881.793590:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946881.794006:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507310336 00000100:00100000:2.0:1783946881.794020:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507310336 00000100:00100000:2.0:1783946881.794155:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 244 00000100:00100000:2.0:1783946881.794170:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11245:x1870603507310336:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783946881.794786:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11245:x1870603507310336:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 Request processed in 617us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946881.794820:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 244 00000100:00080000:3.0:1783946881.795444:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946881.797572:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946881.797658:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946881.797801:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507310592 00000100:00100000:1.0:1783946881.797813:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507310592 00000100:00100000:1.0:1783946881.797888:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:1.0:1783946881.797902:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:11245:x1870603507310592:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783946881.798381:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507310720 00000100:00100000:2.0:1783946881.798388:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507310720 00000100:00100000:2.0:1783946881.798438:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 245 00000100:00100000:2.0:1783946881.798459:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+5:12045:x1870603507310720:12345-192.168.201.18@tcp:101:lsof.0 00010000:00010000:2.0:1783946881.798473:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946881.798502:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db82a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572250 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946881.798572:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db82ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946881.798591:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db82ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946881.798605:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db82ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783946881.798641:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783946881.798658:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783946881.798682:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db82ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946881.798705:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9000/0x229d2ec450db82a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572250 expref: 7 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946881.798725:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db82ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572250 expref: 6 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946881.798759:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be239100) 00010000:00010000:2.0:1783946881.798763:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783946881.798767:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9800, rc 0) 00000100:00080000:3.0:1783946881.798853:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946881.799033:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:11245:x1870603507310592:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 1133us (1473us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1783946881.799045:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:2.0:1783946881.799171:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:12045:x1870603507310720:12345-192.168.201.18@tcp:101:lsof.0 Request processed in 721us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946881.799178:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 245 00000100:00100000:3.0:1783946881.936336:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523021952:0@lo:400:kworker.0 00000100:00100000:0.0:1783946881.936360:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523021824:0@lo:400:kworker.0 00000100:00100000:2.0:1783946881.936473:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523021568:0@lo:400:kworker.0 00000100:00100000:1.0:1783946881.936524:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523021696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946881.939047:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946881.939192:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523021952 00000100:00100000:3.0:1783946881.939202:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523021952 00000100:00100000:3.0:1783946881.939262:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783946881.940362:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946881.940436:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523022336:0@lo:400:kworker.0 00000100:00100000:0.0:1783946881.940493:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946881.940559:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523022336 00000100:00100000:0.0:1783946881.940566:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523022336 00000100:00100000:0.0:1783946881.940736:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783946881.940748:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523022336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946881.940819:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523022336:12345-0@lo:400:kworker.0 Request processed in 74us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946881.940828:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783946881.940879:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523022336:0@lo:400:kworker.0 00000100:00100000:0.0:1783946881.940908:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523021824 00000100:00100000:0.0:1783946881.940929:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523021824 00000100:00100000:3.0:1783946881.943602:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603523021952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946881.943852:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603523021952:12345-0@lo:400:kworker.0 Request processed in 277us (4813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946881.944226:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946881.944660:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523022080:0@lo:400:kworker.0 00000100:00100000:2.0:1783946881.944708:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946881.944791:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523021568 00000100:00100000:2.0:1783946881.944800:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523021568 00000100:00100000:2.0:1783946881.944857:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1783946881.944867:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523021568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946881.944920:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523021568:12345-0@lo:400:kworker.0 Request processed in 53us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946881.944928:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1783946881.944989:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523021568:0@lo:400:kworker.0 00000100:00080000:2.0:1783946881.945164:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783946881.945172:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946881.945210:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523021952:0@lo:400:kworker.0 00000100:00100000:2.0:1783946881.945245:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523022080 00000100:00100000:2.0:1783946881.945249:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523022080 00000100:00100000:2.0:1783946881.945278:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783946881.945902:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783946881.945957:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523022080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946881.946131:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523022080:12345-0@lo:400:kworker.0 Request processed in 179us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946881.946138:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783946881.946179:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523022080:0@lo:400:kworker.0 00000100:00100000:1.0:1783946881.946405:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946881.946455:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523022208:0@lo:400:kworker.0 00000100:00100000:1.0:1783946881.946662:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946881.946691:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523022208 00000100:00100000:1.0:1783946881.946698:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523022208 00000100:00100000:2.0:1783946881.947099:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523021696 00000100:00100000:2.0:1783946881.947105:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523021696 00000100:00100000:2.0:1783946881.947153:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783946881.947162:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523021696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783946881.947206:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946881.947267:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523021696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946881.947274:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1783946881.947422:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946881.947823:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783946881.947841:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be6fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523021824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946881.947970:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be6fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523021824:12345-0@lo:400:kworker.0 Request processed in 137us (7618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946881.947978:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783946881.948084:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523021696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946881.948225:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523021824:0@lo:400:kworker.0 00000100:00100000:1.0:1783946881.949791:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783946881.949820:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603523022208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946881.949944:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603523022208:12345-0@lo:400:kworker.0 Request processed in 139us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946881.949952:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783946881.950957:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523022208:0@lo:400:kworker.0 00010000:00010000:0.0:1783946882.320705:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946883.344579:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946883.958283:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946883.958338:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946883.958406:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946883.958438:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946883.958480:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507310976 00000100:00100000:3.0:1783946883.958494:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507310976 00000100:00100000:3.0:1783946883.958570:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507311232 00000100:00100000:3.0:1783946883.958574:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507311232 00000100:00100000:3.0:1783946883.958597:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:3.0:1783946883.958607:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:2363:x1870603507310976:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946883.958910:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:0.0:1783946883.958922:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5851e04-311c-4929-a2c6-87673cd4c005+6:2363:x1870603507311232:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946883.959037:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5851e04-311c-4929-a2c6-87673cd4c005+6:2363:x1870603507311232:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 117us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946883.959047:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:1.0:1783946883.959463:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507311104 00000100:00100000:1.0:1783946883.959469:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507311104 00000100:00100000:1.0:1783946883.959511:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:1.0:1783946883.959520:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137bdee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507311104:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946883.959626:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507310848 00000100:00100000:2.0:1783946883.959630:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507310848 00000100:00100000:2.0:1783946883.959680:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 317 00000100:00100000:2.0:1783946883.959689:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507310848:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946883.959748:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:2363:x1870603507310976:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 1142us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946883.959755:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00080000:3.0:1783946883.959802:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783946883.959808:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946883.967094:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137bdee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507311104:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 7539us (8719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946883.967115:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:2.0:1783946883.967861:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507310848:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 8163us (9584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946883.967875:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 317 00010000:00010000:0.0:1783946884.368277:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783946885.009532:0:8015:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:2.0:1783946885.009550:0:8015:0:(genops.c:906:class_export_put()) final put ffff9137be509800/c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:2.0:1783946885.009610:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137be509800/c2268401-da9f-4e1e-8a1c-9473caf67cba for lustre-OST0001 00000020:00000080:2.0:1783946885.009728:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137be50b000 for lustre-OST0001 00010000:00010000:0.0:1783946885.397752:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783946885.940803:0:13112:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:48:04 (1783946884) 00000100:00100000:2.0:1783946886.033513:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523022464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946886.033656:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946886.033786:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523022464 00000100:00100000:3.0:1783946886.033796:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523022464 00000100:00100000:3.0:1783946886.033878:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783946886.033891:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523022464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783946886.033943:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:3.0:1783946886.034336:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523022464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 447us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946886.034345:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1783946886.034376:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946886.034516:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523022464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783946886.419868:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946887.061311:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be94d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523022592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946887.061412:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946887.061526:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523022592 00000100:00100000:2.0:1783946887.061535:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523022592 00000100:00100000:2.0:1783946887.061629:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783946887.061641:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523022592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783946887.061682:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946887.061737:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523022592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946887.061745:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1783946887.061768:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783946887.061814:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be94d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523022592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946887.069805:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523022848:0@lo:400:kworker.0 00000100:00100000:3.0:1783946887.069903:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946887.069975:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946887.069981:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523022976:0@lo:400:kworker.0 00000100:00100000:3.0:1783946887.070004:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946887.070136:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523022848 00000100:00100000:3.0:1783946887.070144:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523022848 00000100:00100000:3.0:1783946887.070214:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523022976 00000100:00100000:3.0:1783946887.070217:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523022976 00000100:00100000:2.0:1783946887.070521:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603523022720:0@lo:400:kworker.0 00000100:00100000:2.0:1783946887.070579:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946887.070617:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b9ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523023232:0@lo:400:kworker.0 00000100:00100000:2.0:1783946887.070642:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946887.070666:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946887.070672:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be49ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523023104:0@lo:400:kworker.0 00000100:00100000:2.0:1783946887.070705:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946887.070740:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523022720 00000100:00100000:2.0:1783946887.070755:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523022720 00000100:00100000:2.0:1783946887.070793:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1783946887.070804:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603523022720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946887.070869:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603523022720:12345-0@lo:400:kworker.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946887.070878:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1783946887.070919:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523023104 00000100:00100000:2.0:1783946887.070923:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523023104 00000100:00100000:2.0:1783946887.070952:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783946887.070959:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523023104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946887.070991:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523023104:12345-0@lo:400:kworker.0 Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946887.070998:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783946887.071043:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523023104:0@lo:400:kworker.0 00000100:00100000:2.0:1783946887.071053:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603523022720:0@lo:400:kworker.0 00000100:00100000:3.0:1783946887.071704:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523023232 00000100:00100000:3.0:1783946887.071714:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523023232 00000100:00100000:3.0:1783946887.071740:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783946887.071749:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523022848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946887.071818:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523022848:12345-0@lo:400:kworker.0 Request processed in 70us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946887.071825:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783946887.071845:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783946887.071851:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523022976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946887.071879:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523022976:12345-0@lo:400:kworker.0 Request processed in 29us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946887.071885:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783946887.071896:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783946887.071903:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603523023232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946887.071932:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603523023232:12345-0@lo:400:kworker.0 Request processed in 30us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946887.071937:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783946887.072005:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523022976:0@lo:400:kworker.0 00000100:00100000:3.0:1783946887.072019:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523022848:0@lo:400:kworker.0 00000100:00080000:2.0:1783946887.073401:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946887.073469:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b9ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523023232:0@lo:400:kworker.0 00010000:00010000:2.0:1783946887.440700:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783946888.097493:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:0.0:1783946888.467997:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946889.075053:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946889.075182:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946889.075344:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507311360 00000100:00100000:2.0:1783946889.075354:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507311360 00000100:00100000:2.0:1783946889.075424:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 319 00000100:00100000:2.0:1783946889.075436:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507311360:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1783946889.075515:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91379d61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2363:x1870603507311360:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 82us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946889.075555:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 319 00000100:00100000:3.0:1783946889.075852:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946889.075899:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946889.075934:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507311488 00000100:00100000:3.0:1783946889.075939:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507311488 00000100:00100000:3.0:1783946889.075981:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507311744 00000100:00100000:3.0:1783946889.075984:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507311744 00000100:00100000:3.0:1783946889.076007:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:3.0:1783946889.076015:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2364:x1870603507311488:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946889.076175:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:2364:x1870603507311488:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 160us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946889.076183:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:3.0:1783946889.076201:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:3.0:1783946889.076208:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:2364:x1870603507311744:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783946889.076232:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5851e04-311c-4929-a2c6-87673cd4c005+6:2364:x1870603507311744:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946889.076238:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00080000:2.0:1783946889.077770:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946889.081805:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507311616 00000100:00100000:0.0:1783946889.081822:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507311616 00000100:00100000:0.0:1783946889.082244:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:0.0:1783946889.082257:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507311616:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783946889.082362:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2363:x1870603507311616:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 107us (7179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946889.082388:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00080000:2.0:1783946889.092183:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1783946889.168575:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783946889.168585:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783946889.169544:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1783946889.169558:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783946889.490644:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946890.512335:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946890.858635:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946890.858770:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507312000 00000100:00100000:2.0:1783946890.858782:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507312000 00000100:00100000:2.0:1783946890.858851:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:2.0:1783946890.858862:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+18:12267:x1870603507312000:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:2.0:1783946890.859203:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:12267:x1870603507312000:12345-192.168.201.18@tcp:35:umount.0 Request processed in 342us (580us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1783946890.859212:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:3.0:1783946890.861960:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946890.862125:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507312256 00000100:00100000:2.0:1783946890.862134:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507312256 00000100:00100000:2.0:1783946890.862192:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:2.0:1783946890.862202:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+19:12267:x1870603507312256:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:2.0:1783946890.862538:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:12267:x1870603507312256:12345-192.168.201.18@tcp:35:umount.0 Request processed in 336us (586us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1783946890.862547:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:3.0:1783946890.871263:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946890.871500:0:5960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507312512 00000100:00100000:2.0:1783946890.871511:0:5960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507312512 00000100:00100000:2.0:1783946890.871683:0:5960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:2.0:1783946890.871695:0:5960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a07e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+20:12267:x1870603507312512:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:2.0:1783946890.872103:0:5960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a07e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:12267:x1870603507312512:12345-192.168.201.18@tcp:35:umount.0 Request processed in 409us (848us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1783946890.872112:0:5960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:3.0:1783946890.874671:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946890.874851:0:5959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507312768 00000100:00100000:0.0:1783946890.874862:0:5959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507312768 00000100:00100000:0.0:1783946890.874917:0:5959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:0.0:1783946890.874926:0:5959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:12267:x1870603507312768:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:0.0:1783946890.875276:0:5959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:12267:x1870603507312768:12345-192.168.201.18@tcp:35:umount.0 Request processed in 349us (612us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1783946890.875284:0:5959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:3.0:1783946890.879029:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946890.879325:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507313024 00000100:00100000:0.0:1783946890.879335:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507313024 00000100:00100000:0.0:1783946890.879411:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1783946890.879422:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2362:x1870603507313024:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946890.879449:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946890.879473:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f44400/0x229d2ec450db7238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571d79 expref: 13 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946890.879501:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946890.879807:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:2362:x1870603507313024:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 386us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946890.879816:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1783946890.879959:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946890.880036:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946890.880110:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507312896 00000100:00100000:2.0:1783946890.880116:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507312896 00000100:00100000:2.0:1783946890.880160:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507313152 00000100:00100000:2.0:1783946890.880163:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507313152 00000100:00100000:2.0:1783946890.880181:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:2.0:1783946890.880189:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3530c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1345f16d-a45e-4353-9d75-4f3fd8acb991+13:2361:x1870603507312896:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783946890.880199:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946890.880211:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797623c00/0x229d2ec450db72d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571db1 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946890.880224:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946890.880293:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:0.0:1783946890.880308:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1345f16d-a45e-4353-9d75-4f3fd8acb991+12:2362:x1870603507313152:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783946890.880316:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946890.880325:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137be3a8000/0x229d2ec450db74bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e7c expref: 12 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946890.880335:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946890.889020:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3530c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:2361:x1870603507312896:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 8817us (9046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946890.889036:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:0.0:1783946890.889305:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507313152:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 8996us (9266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946890.889314:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1783946890.893391:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946890.895769:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507313536 00000100:00100000:0.0:1783946890.895785:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507313536 00000100:00100000:0.0:1783946890.895856:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:0.0:1783946890.895866:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+7:2360:x1870603507313536:12345-192.168.201.18@tcp:9:umount.0 00000020:00000080:0.0:1783946890.895895:0:6945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7820 00000020:00010000:0.0:1783946890.895902:0:6945:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9137be508000: total 0 00000100:00080000:0.0:1783946890.895907:0:6945:0:(import.c:65:import_set_state_nolock()) ffff9137be50e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783946890.895960:0:6945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1783946890.896145:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2268401-da9f-4e1e-8a1c-9473caf67cba+5:2360:x1870603507313536:12345-192.168.201.18@tcp:9:umount.0 Request processed in 280us (2765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946890.896153:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00000020:00010000:3.0:1783946890.896913:0:5945:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9137be508000: total 0 00010000:00010000:3.0:1783946890.897268:0:5945:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9137be508000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783946890.897331:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db82a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572249 expref: 4 pid: 6944 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946890.897398:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2560613/0x229d2ec450db7bd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572066 expref: 3 pid: 9002 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946890.897415:0:5945:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9137be508000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1783946890.897427:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946890.897429:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946890.897431:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946890.905170:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946890.905651:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507314560 00000100:00100000:3.0:1783946890.905662:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507314560 00000100:00100000:3.0:1783946890.905732:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 246 00000100:00100000:3.0:1783946890.905743:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+22:2360:x1870603507314560:12345-192.168.201.18@tcp:39:umount.0 00000020:00000080:3.0:1783946890.905786:0:5956:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7246 00000020:00010000:3.0:1783946890.905806:0:5956:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9137be1a9800: total 0 00000100:00080000:3.0:1783946890.905812:0:5956:0:(import.c:65:import_set_state_nolock()) ffff9137be1af000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783946890.905848:0:5956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1783946890.906006:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2268401-da9f-4e1e-8a1c-9473caf67cba+21:2360:x1870603507314560:12345-192.168.201.18@tcp:39:umount.0 Request processed in 263us (846us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1783946890.906015:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 246 00000020:00010000:1.0:1783946890.906552:0:5944:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9137be1a9800: total 0 00010000:00010000:1.0:1783946890.906557:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946890.906607:0:5944:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9137be1a9800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783946890.906671:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:1.0:1783946890.906676:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783946890.906684:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8a00/0x229d2ec450db7ab9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572019 expref: 20 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906722:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9137927b9f00) 00010000:00010000:1.0:1783946890.906724:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783946890.906729:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f45c00/0x229d2ec450db7510 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e8a expref: 19 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906757:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:1.0:1783946890.906759:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783946890.906763:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44800/0x229d2ec450db7c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572089 expref: 18 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906776:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:1.0:1783946890.906778:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783946890.906781:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8261 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572234 expref: 17 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906792:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be239100) 00010000:00010000:1.0:1783946890.906794:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783946890.906798:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a9e00/0x229d2ec450db7c3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572082 expref: 16 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906809:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:1.0:1783946890.906811:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783946890.906815:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db828b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572242 expref: 15 pid: 5958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906826:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:1.0:1783946890.906828:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783946890.906838:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137be3a8200/0x229d2ec450db7580 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571ea6 expref: 14 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906851:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9137979fe400) 00010000:00010000:1.0:1783946890.906853:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783946890.906856:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8000/0x229d2ec450db7f43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572162 expref: 13 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906871:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9137be239a00) 00010000:00010000:1.0:1783946890.906873:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783946890.906876:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137b9f44600/0x229d2ec450db787b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571f7f expref: 12 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906889:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137a36ca000) 00010000:00010000:1.0:1783946890.906891:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783946890.906895:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91378151b000/0x229d2ec450db752c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e91 expref: 11 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906907:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:1.0:1783946890.906909:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783946890.906913:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db7b99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572051 expref: 10 pid: 5957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906923:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91379793e900) 00010000:00010000:1.0:1783946890.906926:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783946890.906929:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913780031200/0x229d2ec450db8181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5721fc expref: 9 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906944:0:5944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9137983e1700) 00010000:00010000:1.0:1783946890.906950:0:5944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783946890.906954:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8c00/0x229d2ec450db7bc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57205f expref: 8 pid: 7190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946890.906967:0:5944:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9137be1a9800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1783946890.906979:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946890.906981:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946890.906982:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946891.152328:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783946891.152355:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523023360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946891.152428:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946891.155110:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523023360 00000100:00100000:0.0:1783946891.155123:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523023360 00000100:00100000:0.0:1783946891.155269:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783946891.155281:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523023360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946891.155313:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1783946891.155399:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523023360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (2971us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946891.155421:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1783946891.155522:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783946891.155539:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523023360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783946891.536381:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946892.176750:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523023488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946892.176835:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946892.176966:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523024000:0@lo:400:kworker.0 00000100:00100000:1.0:1783946892.176997:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946892.177029:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783946892.177037:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523023872:0@lo:400:kworker.0 00000100:00100000:3.0:1783946892.177099:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523023616:0@lo:400:kworker.0 00000100:00100000:1.0:1783946892.177129:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946892.177194:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946892.177251:0:5950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523023616 00000100:00100000:3.0:1783946892.177261:0:5950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523023616 00000100:00100000:0.0:1783946892.177285:0:9002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523024000 00000100:00100000:0.0:1783946892.177294:0:9002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523024000 00000100:00100000:3.0:1783946892.177343:0:5950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1783946892.177359:0:5950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523023616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946892.177368:0:9002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783946892.177388:0:9002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523024000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946892.177492:0:9002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523024000:12345-0@lo:400:kworker.0 Request processed in 113us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946892.177495:0:5950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3447:x1870603523023616:12345-0@lo:400:kworker.0 Request processed in 139us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946892.177516:0:9002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783946892.177520:0:5950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1783946892.177629:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523024000:0@lo:400:kworker.0 00000100:00100000:0.0:1783946892.177687:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523023872 00000100:00100000:0.0:1783946892.177691:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523023872 00000100:00100000:0.0:1783946892.177728:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1783946892.177735:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603523023872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946892.177788:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603523023872:12345-0@lo:400:kworker.0 Request processed in 53us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946892.177794:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1783946892.177821:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523023872:0@lo:400:kworker.0 00000100:00100000:2.0:1783946892.177897:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603523023744:0@lo:400:kworker.0 00000100:00100000:2.0:1783946892.177928:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783946892.177960:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946892.177971:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523023744 00000100:00100000:2.0:1783946892.177975:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523023744 00000100:00100000:2.0:1783946892.178002:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1783946892.178008:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603523023744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946892.178042:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603523023744:12345-0@lo:400:kworker.0 Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946892.178048:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1783946892.178093:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603523023744:0@lo:400:kworker.0 00000100:00100000:2.0:1783946892.178122:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523023488 00000100:00100000:2.0:1783946892.178126:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523023488 00000100:00100000:3.0:1783946892.183303:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523023616:0@lo:400:kworker.0 00000100:00100000:3.0:1783946892.183331:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523024128:0@lo:400:kworker.0 00000100:00100000:3.0:1783946892.183450:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783946892.183686:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783946892.190595:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523024128 00000100:00100000:1.0:1783946892.190619:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523024128 00000100:00100000:1.0:1783946892.190749:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783946892.190766:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523024128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946892.190930:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523024128:12345-0@lo:400:kworker.0 Request processed in 170us (7481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946892.190939:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1783946892.191269:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783946892.191293:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523023488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783946892.191328:0:6946:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946892.191427:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523023488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (14591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946892.191436:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783946892.192113:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523024128:0@lo:400:kworker.0 00000100:00080000:3.0:1783946892.192451:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946892.192607:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523023488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783946892.560409:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946892.585349:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946892.585487:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946892.585649:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507314688 00000100:00100000:1.0:1783946892.585664:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507314688 00000100:00100000:1.0:1783946892.585747:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507314944 00000100:00100000:1.0:1783946892.585753:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507314944 00000100:00100000:1.0:1783946892.585788:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:1.0:1783946892.585801:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+11:2362:x1870603507314688:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946892.585828:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946892.585867:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f44200/0x229d2ec450db7318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571dc6 expref: 11 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946892.585890:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946892.585958:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+10:2362:x1870603507314688:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 160us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946892.585965:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:3.0:1783946892.585971:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:3.0:1783946892.585981:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+9:2363:x1870603507314944:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783946892.585991:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946892.586002:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137be3a9a00/0x229d2ec450db74b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571e75 expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946892.586012:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:3.0:1783946892.586014:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946892.586033:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:2363:x1870603507314944:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 55us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946892.586034:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507314816 00000100:00100000:1.0:1783946892.586037:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507314816 00000100:00100000:3.0:1783946892.586040:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:1.0:1783946892.586054:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:1.0:1783946892.587752:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+8:2362:x1870603507314816:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783946892.587782:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946892.587808:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797623000/0x229d2ec450db731f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571df0 expref: 8 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946892.587825:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783946892.587909:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1345f16d-a45e-4353-9d75-4f3fd8acb991+7:2362:x1870603507314816:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1848us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946892.594397:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:0.0:1783946892.594696:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946892.594764:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507315200 00000100:00100000:2.0:1783946892.594776:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507315200 00000100:00080000:3.0:1783946892.594908:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946892.595105:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 247 00000100:00100000:2.0:1783946892.595130:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+6:2360:x1870603507315200:12345-192.168.201.18@tcp:39:umount.0 00000020:00000080:2.0:1783946892.595189:0:5958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db732d 00000020:00010000:2.0:1783946892.595197:0:5958:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9137bdf77800: total 0 00000100:00080000:2.0:1783946892.595203:0:5958:0:(import.c:65:import_set_state_nolock()) ffff9137bdf73000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783946892.595241:0:5958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1783946892.595455:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5851e04-311c-4929-a2c6-87673cd4c005+5:2360:x1870603507315200:12345-192.168.201.18@tcp:39:umount.0 Request processed in 339us (758us total) trans 4294967526 rc 0/0 00000020:00010000:3.0:1783946892.595471:0:5945:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9137bdf77800: total 0 00010000:00010000:3.0:1783946892.595663:0:5945:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9137bdf77800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783946892.595710:0:5945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137be239100) 00010000:00010000:3.0:1783946892.595715:0:5945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946892.595725:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9800/0x229d2ec450db82ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572250 expref: 5 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946892.595777:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 247 00010000:00010000:3.0:1783946892.595778:0:5945:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9137bdf77800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783946892.595791:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946892.595793:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946892.595795:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946892.613237:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946892.613418:0:5951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507315456 00000100:00100000:1.0:1783946892.613473:0:5951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507315456 00000100:00100000:1.0:1783946892.613997:0:5951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 321 00000100:00100000:1.0:1783946892.614010:0:5951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+7:2360:x1870603507315456:12345-192.168.201.18@tcp:251:umount.0 00000020:00000080:1.0:1783946892.614127:0:5951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7223 00000020:00010000:1.0:1783946892.614138:0:5951:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9137a7eee800: total 0 00000100:00080000:1.0:1783946892.614143:0:5951:0:(import.c:65:import_set_state_nolock()) ffff9137a7eed800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783946892.614252:0:5951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a4996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1345f16d-a45e-4353-9d75-4f3fd8acb991+3:2360:x1870603507315456:12345-192.168.201.18@tcp:251:umount.0 Request processed in 245us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946892.614262:0:5951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 321 00000020:00010000:0.0:1783946892.615121:0:5944:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9137a7eee800: total 0 00010000:00010000:0.0:1783946892.615129:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946892.615218:0:5944:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9137a7eee800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783946892.615272:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91378151ac00/0x229d2ec450db72d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f571db8 expref: 2 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946892.615322:0:5944:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9137a7eee800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783946892.615335:0:5944:0:(genops.c:906:class_export_put()) final put ffff9137a7eee800/1345f16d-a45e-4353-9d75-4f3fd8acb991 00010000:00010000:0.0:1783946892.615418:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946892.615420:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946892.615422:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783946892.620228:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a7eee800/1345f16d-a45e-4353-9d75-4f3fd8acb991 for MGS 00000020:00000080:3.0:1783946892.620312:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137a7eed800 for MGS 00010000:00010000:3.0:1783946893.590041:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946894.609208:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783946895.082942:0:13308:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783946895.107335:0:13308:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783946895.107621:0:13308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.107637:0:13308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.107645:0:13308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.107659:0:13308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.108596:0:13308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783946895.108604:0:13308:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783946895.108635:0:13308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783946895.108639:0:13308:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783946895.108645:0:13308:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783946895.108671:0:13308:0:(import.c:65:import_set_state_nolock()) ffff9137b6556800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783946895.108807:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603523024256:0@lo:39:umount.0 00000100:00100000:1.0:1783946895.108887:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783946895.109579:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946895.109588:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.109598:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be200 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946895.109603:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.109613:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946895.109620:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946895.109625:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783946895.109628:0:5945:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783946895.109630:0:5945:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783946895.109661:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.109666:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783946895.109756:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603523024384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783946895.109792:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946895.109861:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523024384 00000100:00100000:1.0:1783946895.109868:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523024384 00000100:00100000:1.0:1783946895.109923:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783946895.109932:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3448:x1870603523024384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783946895.109943:0:5943:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946895.109973:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622200/0x229d2ec450db72af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db72a8 expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946895.109989:0:5943:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946895.110036:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.110055:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35be200/0x229d2ec450db72a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db72af expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.110081:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946895.110083:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946895.110085:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946895.110854:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:3448:x1870603523024384:12345-0@lo:103:ldlm_bl.0 Request processed in 919us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946895.110864:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783946895.110933:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603523024384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783946895.111541:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523024256 00000100:00100000:0.0:1783946895.111558:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523024256 00000100:00100000:0.0:1783946895.111643:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783946895.111658:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1870603523024256:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783946895.111698:0:5957:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7040 00000100:00080000:0.0:1783946895.111710:0:5957:0:(import.c:65:import_set_state_nolock()) ffff9137b9e73000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783946895.111770:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946895.111837:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3446:x1870603523024256:12345-0@lo:39:umount.0 Request processed in 182us (2948us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946895.111847:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000020:00000080:0.0:1783946895.111863:0:5957:0:(genops.c:906:class_export_put()) final put ffff9137b9e72800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1783946895.111878:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b6556800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1783946895.111921:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b9e72800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783946895.111985:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137b9e73000 for lustre-MDT0000 00000100:00100000:1.0:1783946895.112286:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603523024256:0@lo:39:umount.0 00000100:00080000:2.0:1783946895.114281:0:13308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783946895.114289:0:13308:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783946895.114295:0:13308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783946895.116042:0:13308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.116256:0:13308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.116266:0:13308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.116274:0:13308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.116346:0:13308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946895.116353:0:13308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.116360:0:13308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.116384:0:13308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.116398:0:13308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.116646:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783946895.116654:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.116662:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bea00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946895.116666:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.116674:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946895.116692:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946895.116709:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783946895.116712:0:5945:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1783946895.116752:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.116759:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946895.116798:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.116806:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35bea00/0x229d2ec450db72b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db72bd expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.116819:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946895.116823:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.116829:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946895.116833:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.116842:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946895.116850:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946895.116856:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783946895.116859:0:5945:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:0.0:1783946895.116865:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1783946895.116874:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.116889:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946895.116899:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946895.116904:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523024512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783946895.116918:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946895.116922:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946895.116924:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946895.117012:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946895.117036:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783946895.117304:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523024640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783946895.117408:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946895.117487:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523024512 00000100:00100000:0.0:1783946895.117497:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523024512 00000100:00100000:0.0:1783946895.117568:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523024640 00000100:00100000:0.0:1783946895.117572:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523024640 00000100:00100000:0.0:1783946895.117600:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783946895.117611:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+19:3450:x1870603523024512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783946895.117631:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946895.117653:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bf400/0x229d2ec450db72bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db72b6 expref: 19 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946895.117685:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946895.117742:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+18:3450:x1870603523024512:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946895.117753:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783946895.117787:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783946895.117798:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137a3532c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+17:3449:x1870603523024640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783946895.117807:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946895.117821:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f45200/0x229d2ec450db71e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db71dd expref: 17 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946895.117849:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946895.117887:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137a3532c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3449:x1870603523024640:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946895.117895:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783946895.118016:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523024640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783946895.118090:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523024512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783946895.119400:0:13308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783946895.119428:0:13308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35bf000/0x229d2ec450db71dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db71e4 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946895.119457:0:13308:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783946895.119471:0:13308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.119479:0:13308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.119486:0:13308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.119493:0:13308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946895.120115:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946895.120127:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946895.120136:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623600 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:1.0:1783946895.120141:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946895.120152:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783946895.120160:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946895.120166:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783946895.120169:0:5944:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1783946895.120207:0:5944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946895.120213:0:5944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783946895.120244:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946895.120254:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946895.120256:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946895.120258:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946895.120318:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783946895.120973:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603523024768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783946895.121054:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783946895.121288:0:13308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783946895.121295:0:13308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797623600/0x229d2ec450db74df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db74e6 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946895.121311:0:13308:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783946895.121320:0:13308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.121342:0:13308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.121361:0:13308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946895.121368:0:13308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946895.121610:0:8023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523024768 00000100:00100000:0.0:1783946895.121625:0:8023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523024768 00000100:00100000:0.0:1783946895.121724:0:8023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783946895.121738:0:8023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+16:3448:x1870603523024768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783946895.121759:0:8023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946895.121783:0:8023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622600/0x229d2ec450db74e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db74df expref: 16 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946895.121803:0:8023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783946895.121896:0:8023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:3448:x1870603523024768:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946895.121905:0:8023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1783946895.121948:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783946895.121956:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603523024768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783946895.121957:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.122102:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623200 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946895.122108:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.122119:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946895.122126:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946895.122132:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783946895.122135:0:5945:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1783946895.122166:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.122185:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783946895.122296:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603523024896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783946895.122354:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946895.122482:0:5942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523024896 00000100:00100000:1.0:1783946895.122489:0:5942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523024896 00000100:00100000:1.0:1783946895.122532:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783946895.122550:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+15:3448:x1870603523024896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783946895.122562:0:5942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783946895.122576:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137c21d5600/0x229d2ec450db6f98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db6f91 expref: 15 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946895.122596:0:5942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783946895.123245:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946895.123262:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946895.123265:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946895.123267:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946895.123353:0:13308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783946895.123362:0:13308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797623200/0x229d2ec450db6f91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db6f98 expref: -99 pid: 5933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946895.123383:0:13308:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1783946895.123397:0:13308:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1783946895.123400:0:13308:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783946895.123731:0:13308:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783946895.123736:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1783946895.123742:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783946895.123747:0:13308:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1783946895.123753:0:13308:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9137be1aa000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783946895.123759:0:13308:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9137b6557000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783946895.123766:0:13308:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9137bdf77800 d5851e04-311c-4929-a2c6-87673cd4c005 192.168.201.18@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783946895.123770:0:13308:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9137be1a9800 c2268401-da9f-4e1e-8a1c-9473caf67cba 192.168.201.18@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:3.0:1783946895.123775:0:13308:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9137909d19c0) has exports, disconnecting them 00000020:00080000:3.0:1783946895.123779:0:13308:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9137be1aa000), last request at 1783946892 00000020:00000080:3.0:1783946895.123786:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db71a5 00000100:00080000:3.0:1783946895.123813:0:13308:0:(import.c:65:import_set_state_nolock()) ffff9137be1a8800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783946895.123856:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783946895.123870:0:13308:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9137be1aa000): rc 0 00000020:00000080:3.0:1783946895.123873:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137be1aa000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783946895.123885:0:13308:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9137b6557000), last request at 1783946892 00000020:00000080:3.0:1783946895.123888:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db70da 00000100:00080000:3.0:1783946895.123893:0:13308:0:(import.c:65:import_set_state_nolock()) ffff9137b9cd8000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783946895.123903:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783946895.123909:0:13308:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9137b6557000): rc 0 00000020:00000080:3.0:1783946895.123912:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b6557000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1783946895.123918:0:13308:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb5c980d53ae0 00000100:00080000:3.0:1783946895.123936:0:13308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783946895.123940:0:13308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1783946895.123952:0:13308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783946895.124006:0:13308:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783946895.124025:0:13308:0:(import.c:65:import_set_state_nolock()) ffff9137b65dc000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783946895.124042:0:13308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783946895.124045:0:13308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1783946895.124054:0:13308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783946895.124156:0:13308:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783946895.124168:0:13308:0:(import.c:65:import_set_state_nolock()) ffff9137bdc19000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783946895.124195:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9137909d19c0) has no exports 00010000:00010000:2.0:1783946895.124264:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783946895.125134:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137be1aa000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783946895.125182:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b6557000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783946895.125201:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137be1a8800 for lustre-MDT0000 00000020:00000080:2.0:1783946895.125205:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137b9cd8000 for lustre-MDT0000 00000100:00100000:1.0:1783946895.128792:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b032bb55-8d94-4093-96f3-a2f6fadccf82+14:3448:x1870603523024896:12345-0@lo:103:ldlm_bl.0 Request processed in 6227us (6420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946895.128812:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783946895.128941:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523025024:0@lo:9:umount.0 00000100:00100000:1.0:1783946895.129033:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946895.129102:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523025152:0@lo:9:umount.0 00000100:00100000:1.0:1783946895.129127:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946895.129277:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523025024 00000100:00100000:2.0:1783946895.129294:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523025024 00000100:00100000:2.0:1783946895.129373:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523025152 00000100:00100000:2.0:1783946895.129377:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523025152 00000100:00100000:2.0:1783946895.129415:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783946895.129465:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1870603523025024:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783946895.129497:0:6945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7127 00000100:00080000:2.0:1783946895.129507:0:6945:0:(import.c:65:import_set_state_nolock()) ffff9137a4a0d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783946895.129561:0:6945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1783946895.129733:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3446:x1870603523025024:12345-0@lo:9:umount.0 Request processed in 271us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946895.129741:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783946895.129758:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783946895.129764:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1870603523025152:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783946895.129776:0:6945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db720e 00000100:00080000:2.0:1783946895.129795:0:6945:0:(import.c:65:import_set_state_nolock()) ffff9137b9ff7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783946895.129819:0:6945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1783946895.129899:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3446:x1870603523025152:12345-0@lo:9:umount.0 Request processed in 135us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946895.129906:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1783946895.129923:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783946895.130285:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783946895.130290:0:5952:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783946895.130307:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946895.131320:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b032bb55-8d94-4093-96f3-a2f6fadccf82:3448:1870603523024896:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783946895.132485:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b65dc000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783946895.132522:0:3446:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783946895.132526:0:3446:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783946895.132533:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523025024:0@lo:9:umount.0 00000100:00080000:1.0:1783946895.132552:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137bdc19000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783946895.132570:0:3446:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783946895.132572:0:3446:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783946895.132575:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523025152:0@lo:9:umount.0 00000020:00080000:3.0:1783946895.143719:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9137909d19c0) has no exports 00000020:00000080:3.0:1783946895.202829:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6fec 00000020:00000080:3.0:1783946895.202850:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b9cdb000/lustre-QMT0000_UUID 00000020:01000000:3.0:1783946895.202933:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783946895.203100:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783946895.203113:0:13308:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783946895.203119:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9137a0734d40) has no exports 00000020:00000080:1.0:1783946895.203301:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b9cdb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783946895.204183:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6fe5 00000020:00000080:2.0:1783946895.204190:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b9ca0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783946895.204304:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b9ca0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783946895.204381:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783946895.204619:0:13308:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783946895.204624:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b6563000/lustre-QMT0000_UUID 00000020:00000080:2.0:1783946895.204627:0:13308:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b6563000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783946895.204635:0:13308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1783946895.635706:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946896.656324:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783946896.794137:0:5935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d5851e04-311c-4929-a2c6-87673cd4c005 00000001:00080000:0.0:1783946896.794156:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1783946896.794162:0:5935:0:(genops.c:906:class_export_put()) final put ffff9137bdf77800/d5851e04-311c-4929-a2c6-87673cd4c005 00000001:00100000:0.0:1783946896.794235:0:5935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000001:00080000:0.0:1783946896.794242:0:5935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1783946896.794250:0:5935:0:(genops.c:906:class_export_put()) final put ffff9137be1a9800/c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:1.0:1783946896.795479:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9137bdf77800/d5851e04-311c-4929-a2c6-87673cd4c005 for lustre-MDT0000 00000020:00000080:1.0:1783946896.795535:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137bdf73000 for lustre-MDT0000 00000020:00000080:2.0:1783946896.797493:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137be1a9800/c2268401-da9f-4e1e-8a1c-9473caf67cba for lustre-MDT0000 00000020:00000080:2.0:1783946896.807949:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137be1af000 for lustre-MDT0000 00000020:01000000:2.0:1783946897.232209:0:13308:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9137be3bad80 - data ffff9137902e2a20/ffff9137bdc0a800 00000020:01000000:2.0:1783946897.232503:0:13308:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff913792674840 - data ffff913790161798/ffff9137b9cab800 00000001:00000004:2.0:1783946897.239126:0:13308:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1783946897.284743:0:13308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783946897.284754:0:13308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1783946897.285263:0:13308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783946897.285267:0:13308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783946897.285992:0:7311:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783946897.285998:0:7311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1783946897.286007:0:7311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1783946897.286449:0:13308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783946897.286453:0:13308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1783946897.286467:0:13308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783946897.286469:0:13308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783946897.286828:0:8316:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783946897.286831:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1783946897.286847:0:8316:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1783946897.287744:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6fb4 00000020:00000080:3.0:1783946897.287754:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b65d8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783946897.289158:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65d8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783946897.289376:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6fc9 00000020:00000080:3.0:1783946897.289392:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b65dd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783946897.289407:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783946897.289418:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783946897.289426:0:13308:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783946897.289430:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9137909d3380) has no exports 00000020:00000080:0.0:1783946897.289697:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65dd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1783946897.289766:0:13308:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783946897.289774:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7207 00000020:00000080:3.0:1783946897.289778:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b9ff4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783946897.289792:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783946897.289796:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783946897.289802:0:13308:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783946897.289805:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9137b9cf8000) has no exports 00000020:00000080:3.0:1783946897.289813:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7200 00000020:00000080:3.0:1783946897.289816:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137bdf72000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1783946897.290156:0:13308:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783946897.290161:0:13308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783946897.290164:0:13308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1783946897.290169:0:13308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783946897.290171:0:13308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783946897.290196:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783946897.290202:0:13308:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783946897.290207:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7120 00000020:00000080:3.0:1783946897.290218:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137bdc1c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783946897.290221:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783946897.290224:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783946897.290228:0:13308:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783946897.290230:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9137b65e0000) has no exports 00000020:00000080:3.0:1783946897.290234:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7119 00000020:00000080:3.0:1783946897.290236:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b65db800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783946897.290394:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b9ff4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783946897.290401:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137bdf72000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783946897.290407:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137bdc19000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783946897.290422:0:36:0:(genops.c:906:class_export_put()) final put ffff9137bdf76800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783946897.290425:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137bdf76800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783946897.290430:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783946897.290507:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137bdc1c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783946897.290512:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65db800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783946897.291637:0:13308:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783946897.291643:0:13308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783946897.291646:0:13308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1783946897.291651:0:13308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783946897.291652:0:13308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783946897.291819:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783946897.291828:0:13308:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783946897.291852:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783946897.291855:0:13308:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783946897.291859:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b65d9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783946897.291862:0:13308:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65d9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783946897.291867:0:13308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783946897.291994:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6fd0 00000020:00000080:3.0:1783946897.291999:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b65d9000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783946897.292045:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137b65dc000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783946897.292051:0:36:0:(genops.c:906:class_export_put()) final put ffff9137b9ca4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783946897.292053:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b9ca4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783946897.292080:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783946897.292274:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1783946897.292279:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783946897.292283:0:13308:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783946897.292286:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9137b65e3380) has no exports 00000020:00000080:3.0:1783946897.292316:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783946897.292319:0:13308:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1783946897.292324:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6fd7 00000020:00000080:3.0:1783946897.292328:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b65db000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783946897.292748:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65d9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783946897.292753:0:36:0:(genops.c:906:class_export_put()) final put ffff9137b65dc800/lustre-MDD0000_UUID 00000020:00000080:0.0:1783946897.292755:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65dc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783946897.292759:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1783946897.292947:0:13308:0:(tgt_mount.c:187:server_put_mount()) put mount ffff913786178000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1783946897.292951:0:13308:0:(obd_mount.c:710:lustre_put_lsi()) put ffff913786178000 3 00000020:01000004:3.0:1783946897.292955:0:13308:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff913786178000 from lustre-MDT0000 00000020:00000080:3.0:1783946897.292982:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783946897.292987:0:13308:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1783946897.292990:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b65de800/lustre-MDT0000_UUID 00000020:00000080:3.0:1783946897.292992:0:13308:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65de800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1783946897.292997:0:13308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1783946897.293027:0:13308:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1783946897.293031:0:13308:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1783946897.293034:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1783946897.293037:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783946897.293040:0:13308:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783946897.293046:0:13308:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff913782b82000 b032bb55-8d94-4093-96f3-a2f6fadccf82 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783946897.293052:0:13308:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff913792760000) has exports, disconnecting them 00000020:00080000:3.0:1783946897.293056:0:13308:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff913782b82000), last request at 1783946617 00000020:00000080:0.0:1783946897.293126:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b65db000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783946897.293178:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6f75 00000020:00010000:3.0:1783946897.293182:0:13308:0:(genops.c:1942:obd_stale_export_put()) Put export ffff913782b82000: total 0 00000100:00080000:3.0:1783946897.293185:0:13308:0:(import.c:65:import_set_state_nolock()) ffff913782b80800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783946897.293229:0:13308:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff913782b82000): rc 0 00000020:00080000:3.0:1783946897.293234:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff913792760000) has no exports 00000100:00100000:3.0:1783946897.293310:0:5950:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9137a422e200:5950] 1 exiting: rc = 0 00000100:00100000:1.0:1783946897.293458:0:5949:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9137a422e800:5949] 0 exiting: rc = 1 00000100:00100000:1.0:1783946897.293528:0:5951:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9137927bae00:5951] 2 exiting: rc = 0 00000100:00100000:3.0:1783946897.293783:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293791:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293797:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293802:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293809:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293814:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293820:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293825:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293831:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293837:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293843:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293849:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293854:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293870:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293875:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293882:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293888:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293893:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293898:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293904:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293910:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293916:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293922:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293928:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293934:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293940:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293945:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293951:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293957:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293963:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293968:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293974:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293979:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293984:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293991:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.293997:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294002:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294008:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294013:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294018:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294023:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294027:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294032:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294038:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294044:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294050:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294056:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294121:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294135:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294141:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294146:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294152:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294157:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294162:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294167:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294172:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294177:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294182:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294187:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294192:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294197:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294202:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294207:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.294213:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1783946897.295672:0:5944:0:(genops.c:1928:obd_stale_export_get()) Get export ffff913782b82000: total 0 00010000:00010000:1.0:1783946897.295934:0:5944:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff913782b82000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1783946897.295967:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bec00/0x229d2ec450db7285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db727e expref: 9 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946897.295985:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bfc00/0x229d2ec450db7293 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db728c expref: 8 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946897.295996:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797623a00/0x229d2ec450db72a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db729a expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946897.296006:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35be800/0x229d2ec450db72cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db72c4 expref: 6 pid: 5950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946897.296017:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137be3a8800/0x229d2ec450db74ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db74c3 expref: 5 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946897.296026:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622c00/0x229d2ec450db74d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db74d1 expref: 4 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946897.296039:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137c21d4200/0x229d2ec450db708d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db7086 expref: 3 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946897.296051:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91378151be00/0x229d2ec450db7277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x229d2ec450db7270 expref: 2 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946897.296096:0:5944:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff913782b82000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1783946897.296109:0:5944:0:(genops.c:906:class_export_put()) final put ffff913782b82000/b032bb55-8d94-4093-96f3-a2f6fadccf82 00010000:00010000:1.0:1783946897.296124:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946897.296134:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946897.296136:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783946897.296144:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff913782b82000/b032bb55-8d94-4093-96f3-a2f6fadccf82 for MGS 00000020:00000080:1.0:1783946897.296170:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff913782b80800 for MGS 00000020:01000000:3.0:1783946897.297022:0:13308:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9137a7ef6f00 - data ffff913790202af8/ffff9137bdc2c000 00000020:01000000:3.0:1783946897.297167:0:13308:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91379271e900 - data ffff913792eba0d8/ffff9137a4994000 00000020:00000080:3.0:1783946897.297826:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6f59 00000020:00000080:3.0:1783946897.297834:0:13308:0:(genops.c:906:class_export_put()) final put ffff91379278f000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783946897.297854:0:13308:0:(tgt_mount.c:187:server_put_mount()) put mount ffff913786178000 from MGS, refs=2 00000020:01000004:3.0:1783946897.297859:0:13308:0:(obd_mount.c:710:lustre_put_lsi()) put ffff913786178000 2 00000020:01000004:3.0:1783946897.297862:0:13308:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff913786178000 from MGS 00000020:00000080:3.0:1783946897.297883:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783946897.297890:0:13308:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783946897.297893:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137830fc800/MGS 00000020:00000080:3.0:1783946897.297895:0:13308:0:(genops.c:865:class_export_destroy()) destroying export ffff9137830fc800/MGS for MGS 00000020:01000000:3.0:1783946897.297901:0:13308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1783946897.297952:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783946897.297957:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783946897.297962:0:13308:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783946897.297967:0:13308:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9137b6550000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783946897.297973:0:13308:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9137b9cfcd40) has exports, disconnecting them 00000020:00080000:3.0:1783946897.297983:0:13308:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9137b6550000), last request at 1783946617 00000020:00000080:3.0:1783946897.297987:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7024 00000020:00080000:3.0:1783946897.297996:0:13308:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9137b6550000): rc 0 00000020:00000080:3.0:1783946897.298000:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b6550000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783946897.298555:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91379278f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783946897.298565:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b6550000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000100:00100000:1.0:1783946897.299450:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523025408:0@lo:400:kworker.0 00000100:00100000:1.0:1783946897.299520:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946897.299579:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783946897.299586:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523025280:0@lo:400:kworker.0 00000400:00000100:1.0:1783946897.299607:0:3450:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870603523025280 offset 0 length 224: 4 00000100:00100000:1.0:1783946897.299638:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523025408 00000100:00100000:1.0:1783946897.299646:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523025408 00000100:00100000:1.0:1783946897.299685:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1783946897.299693:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3450:x1870603523025408:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783946897.299700:0:5956:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783946897.299737:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3450:x1870603523025408:12345-0@lo:400:kworker.0 Request processed in 43us (216us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783946897.299744:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:1.0:1783946897.299780:0:3450:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783946897.299785:0:3450:0:(import.c:65:import_set_state_nolock()) ffff9137a7eee000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783946897.299789:0:3450:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783946897.305185:0:3450:0:(import.c:65:import_set_state_nolock()) ffff9137a7eee000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783946897.305199:0:3450:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 247 00000100:00080000:1.0:1783946897.305209:0:3450:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9137a7eee000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946897.305250:0:3450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be93ea00 x1870603523025664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783946897.305295:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523025408:0@lo:400:kworker.0 00000100:00100000:1.0:1783946897.305331:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783946897.305348:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523025536:0@lo:400:kworker.0 00000100:00100000:1.0:1783946897.305447:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946897.305493:0:7190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523025536 00000100:00100000:1.0:1783946897.305501:0:7190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523025536 00000100:00100000:1.0:1783946897.305541:0:7190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1783946897.305549:0:7190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3448:x1870603523025536:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783946897.305557:0:7190:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783946897.305592:0:7190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3448:x1870603523025536:12345-0@lo:400:kworker.0 Request processed in 42us (145us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783946897.305600:0:7190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1783946897.305638:0:3448:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783946897.305642:0:3448:0:(import.c:65:import_set_state_nolock()) ffff9137be1a8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783946897.305645:0:3448:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783946897.305648:0:3448:0:(import.c:65:import_set_state_nolock()) ffff9137be1a8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783946897.305651:0:3448:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 270 00000100:00080000:1.0:1783946897.305654:0:3448:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9137be1a8000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946897.305667:0:3448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be93e300 x1870603523025792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783946897.305677:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523025536:0@lo:400:kworker.0 00000100:00100000:0.0:1783946897.305787:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3446:1870603523025664:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783946897.305817:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946897.305837:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3446:1870603523025792:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1783946897.305864:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946897.305893:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523025664 00000100:00100000:0.0:1783946897.305897:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523025664 00000100:00100000:0.0:1783946897.305915:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523025792 00000100:00100000:0.0:1783946897.305918:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523025792 00000100:00100000:0.0:1783946897.305932:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783946897.305936:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3446:x1870603523025664:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1783946897.305952:0:5958:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783946897.305983:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3446:x1870603523025664:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 45us (165us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783946897.305990:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783946897.306003:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783946897.306007:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3446:x1870603523025792:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1783946897.306014:0:5958:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783946897.306046:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3446:x1870603523025792:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 37us (187us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783946897.306051:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:0.0:1783946897.306097:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137a7eee000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783946897.306102:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783946897.306105:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3446:1870603523025664:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1783946897.306112:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137be1a8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783946897.306115:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783946897.306118:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3446:1870603523025792:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:0.0:1783946897.307279:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783946897.307285:0:6938:0:(genops.c:906:class_export_put()) final put ffff9137a4a0d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783946897.307299:0:6938:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:0.0:1783946897.307313:0:6938:0:(genops.c:906:class_export_put()) final put ffff9137be508000/c2268401-da9f-4e1e-8a1c-9473caf67cba 00000020:00000080:1.0:1783946897.310496:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a4a0d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783946897.310611:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9137be508000/c2268401-da9f-4e1e-8a1c-9473caf67cba for lustre-OST0000 00000020:00000080:1.0:1783946897.310629:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137a4a0d000 for lustre-OST0000 00000020:00000080:1.0:1783946897.310650:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137be50e800 for lustre-OST0000 00010000:01000000:0.0:1783946897.311375:0:13308:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783946897.311388:0:13308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783946897.311392:0:13308:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783946897.311400:0:13308:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783946897.311817:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783946897.311826:0:13308:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783946897.311835:0:13308:0:(obd_mount.c:710:lustre_put_lsi()) put ffff913786178000 1 00000020:00000080:0.0:1783946897.311841:0:13308:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6f4b 00000020:00000080:0.0:1783946897.311849:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137a4076000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783946897.311855:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783946897.311859:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783946897.311863:0:13308:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783946897.311866:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9137a0730000) has no exports 00000020:00000080:1.0:1783946897.314236:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137b6556800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783946897.314248:0:36:0:(genops.c:906:class_export_put()) final put ffff9137b6552800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783946897.314251:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b6552800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783946897.314258:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1783946897.314336:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a4076000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783946897.414201:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783946897.414215:0:13308:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783946897.414221:0:13308:0:(genops.c:906:class_export_put()) final put ffff91378617f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783946897.414225:0:13308:0:(genops.c:865:class_export_destroy()) destroying export ffff91378617f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783946897.414237:0:13308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783946897.414356:0:13308:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91378617c000 00000020:01000000:2.0:1783946897.414389:0:13308:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1783946897.414393:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783946897.414406:0:13308:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783946897.414826:0:13308:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9137909d4d40) has no exports 00000100:00100000:3.0:1783946897.421149:0:5956:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9137a07a0200:5956] 0 exiting: rc = 1 00000100:00100000:2.0:1783946897.421610:0:5957:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff913782c98000:5957] 1 exiting: rc = 0 00000100:00100000:2.0:1783946897.421677:0:7190:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9137a7ed6600:7190] 3 exiting: rc = 0 00000100:00100000:2.0:1783946897.421769:0:5958:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9137a0769600:5958] 2 exiting: rc = 0 00000100:00100000:3.0:1783946897.421861:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421868:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421874:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421879:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421885:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421891:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421897:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421903:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421908:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421915:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421921:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421927:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421932:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421937:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421943:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421949:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421955:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421960:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421966:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421972:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421977:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421983:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421988:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.421994:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422000:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422005:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422010:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422015:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422020:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422045:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422051:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422056:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422105:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422112:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422118:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422124:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422129:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422134:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422139:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422145:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422150:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422156:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422163:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422169:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422173:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422178:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422183:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422188:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422194:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422199:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422205:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422211:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422217:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422222:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422227:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422233:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422238:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422244:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422249:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422254:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422259:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422265:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422271:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.422276:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.428720:0:5960:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9137a0768000:5960] 1 exiting: rc = 0 00000100:00100000:1.0:1783946897.430665:0:5959:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9137a07f8800:5959] 0 exiting: rc = 1 00000100:00100000:2.0:1783946897.430822:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430832:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430839:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430844:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430850:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430856:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430863:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430869:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430875:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430880:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430886:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430893:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430899:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430905:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430911:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430916:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430922:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430927:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430932:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430937:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430943:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430949:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430955:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430960:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430966:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430971:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430976:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430982:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430988:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.430993:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431011:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431016:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431021:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431026:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431031:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431036:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431041:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431046:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431051:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431251:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431261:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431266:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431271:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431276:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431281:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431286:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431291:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431355:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431366:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431372:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431376:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431390:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431395:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431399:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431403:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431468:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431476:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431482:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431486:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431491:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431496:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431501:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431506:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.431511:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.432392:0:5961:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff913791a92000:5961] 0 exiting: rc = 1 00000100:00100000:0.0:1783946897.432728:0:5962:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff91378393d800:5962] 1 exiting: rc = 0 00000100:00100000:3.0:1783946897.432841:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432849:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432856:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432863:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432869:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432875:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432881:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432888:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432894:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432911:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432919:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432925:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432930:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432936:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432942:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432949:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432955:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432961:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432968:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432975:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.432981:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433003:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433010:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433016:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433022:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433028:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433033:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433039:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433045:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433051:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433246:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433255:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433262:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433284:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433364:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433372:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433403:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433505:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433513:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433518:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433523:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433529:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433534:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433540:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433606:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433628:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433635:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433641:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433647:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433653:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433659:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433664:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433670:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433676:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433681:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433687:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433692:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433711:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433719:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433724:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433730:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433736:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433742:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.433749:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946897.447541:0:5963:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91378393ce00:5963] 0 exiting: rc = 1 00000100:00100000:3.0:1783946897.447695:0:5964:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91378393d600:5964] 1 exiting: rc = 0 00000100:00100000:3.0:1783946897.448213:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448223:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448229:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448235:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448254:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448261:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448266:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448272:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448277:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448283:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448288:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448295:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448311:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448317:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448323:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448327:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448333:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448338:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448343:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448349:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448354:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448359:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448364:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448370:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448375:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448389:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448395:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448400:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448405:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448519:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448524:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448529:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448535:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448540:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448555:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448562:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448567:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448572:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448577:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448591:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448596:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448600:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448606:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448611:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448616:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448621:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448626:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448631:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448637:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448642:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448647:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448652:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448657:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448661:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448665:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448670:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448675:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448680:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448685:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448690:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448695:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448701:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448705:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.448711:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946897.449193:0:5966:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff913791a92400:5966] 1 exiting: rc = 0 00000100:00100000:2.0:1783946897.449319:0:5965:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9137862f1a00:5965] 0 exiting: rc = 1 00000100:00100000:3.0:1783946897.449508:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449514:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449519:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449525:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449529:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449534:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449599:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449607:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449612:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449616:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449631:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449636:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449641:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449646:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449651:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449657:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449663:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449669:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449674:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449679:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449685:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449690:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449695:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449700:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449705:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449710:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449715:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449720:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449726:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449731:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449737:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449742:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449747:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449753:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449758:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449763:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449768:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449774:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449779:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449784:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449790:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449795:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449800:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449805:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449810:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449822:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449828:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449833:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449838:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449844:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449849:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449853:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449859:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449864:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449869:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449875:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449879:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449884:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449889:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449893:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449898:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449903:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449909:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.449915:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946897.450290:0:5967:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9137862f0400:5967] 0 exiting: rc = 1 00000100:00100000:2.0:1783946897.450529:0:5968:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff913792759600:5968] 1 exiting: rc = 0 00000100:00100000:3.0:1783946897.450677:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450683:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450688:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450692:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450697:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450702:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450707:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450712:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450717:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450722:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450728:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450733:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450739:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450744:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450749:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450753:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450768:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450772:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450777:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450782:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450787:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450792:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450798:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450803:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450807:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450812:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450817:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450821:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450826:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450831:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450837:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450841:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450846:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450852:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450857:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450862:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450867:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450872:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450878:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450883:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450888:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450892:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450897:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450901:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450906:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450910:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450914:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450919:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450923:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450928:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450933:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450945:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450949:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450955:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450960:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450965:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450970:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450975:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450981:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450985:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450990:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.450995:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.451001:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.451006:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946897.452180:0:5969:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9137909d8200:5969] 0 exiting: rc = 1 00000100:00100000:0.0:1783946897.452611:0:5971:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff913792672000:5971] 2 exiting: rc = 0 00000100:00100000:2.0:1783946897.452920:0:5970:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff913792758c00:5970] 1 exiting: rc = 0 00000100:00100000:3.0:1783946897.453043:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453050:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453055:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453123:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453129:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453134:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453141:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453146:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453151:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453157:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453163:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453168:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453174:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453179:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453185:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453191:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453196:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453202:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453208:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453215:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453220:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453225:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453239:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453245:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453264:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453271:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453277:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453284:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453290:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453296:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453646:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453652:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453658:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453664:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453670:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453675:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453681:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453687:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453692:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453698:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453704:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453711:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453717:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453722:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453728:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453733:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453740:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453745:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453767:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453774:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453780:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453785:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453792:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453798:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453804:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453810:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453816:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453830:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453836:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453842:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453848:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453855:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453861:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783946897.453866:0:13308:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783946897.459480:0:13308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783946897.459496:0:13308:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1783946897.459502:0:13308:0:(genops.c:906:class_export_put()) final put ffff9137b63d8800/MDS_uuid 00000020:00000080:3.0:1783946897.459507:0:13308:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b63d8800/MDS_uuid for MDS 00000020:01000000:3.0:1783946897.459514:0:13308:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1783946897.459718:0:13308:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1783946897.693564:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946898.722456:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946899.728147:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946900.763638:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783946900.892866:0:8015:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783946900.892879:0:8015:0:(genops.c:906:class_export_put()) final put ffff9137b9ff6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783946900.893095:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b9ff6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783946900.893154:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137b9ff7000 for lustre-OST0001 00010000:00010000:2.0:1783946901.780538:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783946902.423465:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783946902.423474:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783946902.423478:0:36:0:(import.c:65:import_set_state_nolock()) ffff9137a7eee000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783946902.423488:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1783946902.423494:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783946902.423501:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9137a7eee000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1783946902.423529:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be847b80 x1870603523026048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783946902.423547:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783946902.423612:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783946902.423615:0:36:0:(import.c:65:import_set_state_nolock()) ffff9137be1a8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783946902.423620:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1783946902.423623:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783946902.423626:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9137be1a8000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946902.423629:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946902.423641:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3446:1870603523026048:0@lo:38:kworker.0 00000100:00100000:1.0:1783946902.423644:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523025920:0@lo:400:kworker.0 00000100:00100000:3.0:1783946902.423829:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be8b0380 x1870603523026176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1783946902.424207:0:3446:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870603523026048 offset 0 length 520: 4 00000100:00100000:2.0:1783946902.424336:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3446:1870603523026176:0@lo:38:kworker.0 00000400:00000100:2.0:1783946902.424359:0:3446:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870603523026176 offset 0 length 520: 4 00000400:00000100:1.0:1783946902.425575:0:3447:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870603523025920 offset 0 length 224: 4 00010000:00010000:1.0:1783946902.800575:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946903.827022:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946904.852272:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946905.873358:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783946906.308293:0:13509:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783946906.328314:0:13509:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1783946906.328383:0:13509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.328397:0:13509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.328405:0:13509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.328412:0:13509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.328432:0:13509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783946906.328438:0:13509:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783946906.328465:0:13509:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783946906.328478:0:13509:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9137be847b80 x1870603523026048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783946917 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946906.328499:0:13509:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783946906.328506:0:13509:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783946906.328512:0:13509:0:(import.c:65:import_set_state_nolock()) ffff9137a7eee000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1783946906.328517:0:13509:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783946906.328520:0:13509:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9137be847b80 x1870603523026048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783946917 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946906.328526:0:13509:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783946906.328529:0:13509:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:0.0:1783946906.328736:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3446:1870603523026048:0@lo:38:kworker.0 00010000:00010000:2.0:1783946906.329739:0:13509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.329753:0:13509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.329769:0:13509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.329776:0:13509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.329794:0:13509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783946906.329801:0:13509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.329808:0:13509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.329814:0:13509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.329820:0:13509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946906.329828:0:13509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1783946906.329832:0:13509:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1783946906.329853:0:13509:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1783946906.329857:0:13509:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1783946906.329861:0:13509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783946906.329867:0:13509:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783946906.329871:0:13509:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9137a0733380) has no exports 00000020:00080000:2.0:1783946906.329897:0:13509:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9137a0733380) has no exports 00000020:01000000:2.0:1783946906.331610:0:13509:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9137a7ef6d20 - data ffff913790189000/ffff9137862fac00 00000020:01000000:2.0:1783946906.331766:0:13509:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9137b9e522a0 - data ffff91379013cbd0/ffff9137a7c3dc00 00010000:00010000:3.0:1783946906.332126:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783946906.332136:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332148:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623800 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946906.332151:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332161:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946906.332168:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946906.332174:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783946906.332183:0:5945:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783946906.332187:0:5945:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783946906.332239:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332245:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783946906.332271:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332278:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797623800/0x229d2ec450db728c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db7293 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332290:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783946906.332293:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332299:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfa00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946906.332303:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332309:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946906.332316:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946906.332321:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783946906.332324:0:5945:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1783946906.332326:0:5945:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1783946906.332336:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332351:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783946906.332357:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332364:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35bfa00/0x229d2ec450db729a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db72a1 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332372:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946906.332376:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332382:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45600 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946906.332384:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332391:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946906.332398:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946906.332403:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783946906.332405:0:5945:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783946906.332407:0:5945:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783946906.332416:0:5945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332422:0:5945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783946906.332435:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332451:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137b9f45600/0x229d2ec450db74d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x229d2ec450db74d8 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946906.332460:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946906.332461:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946906.332463:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946906.332481:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523026304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783946906.332542:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946906.332593:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946906.332599:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523026432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783946906.332618:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946906.332648:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523026560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783946906.332668:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946906.332700:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523026304 00000100:00100000:3.0:1783946906.332706:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523026304 00000100:00100000:3.0:1783946906.332737:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523026432 00000100:00100000:3.0:1783946906.332740:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523026432 00000100:00100000:3.0:1783946906.332748:0:5943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523026560 00000100:00100000:3.0:1783946906.332750:0:5943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523026560 00000100:00100000:3.0:1783946906.332760:0:5943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783946906.332767:0:5943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3449:x1870603523026304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783946906.332773:0:5943:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783946906 with bad export cookie 2494201189338148725 00010000:00010000:1.0:1783946906.337361:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946906.337414:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783946906.337428:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3449:x1870603523026432:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783946906.337437:0:5942:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783946906 with bad export cookie 2494201189338148725 00000100:00100000:1.0:1783946906.337561:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3449:x1870603523026432:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (4940us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783946906.337569:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783946906.337600:0:5942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783946906.337622:0:5942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3447:x1870603523026560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783946906.337628:0:5942:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783946906 with bad export cookie 2494201189338148725 00000100:00100000:1.0:1783946906.337668:0:5942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3447:x1870603523026560:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (4999us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783946906.337674:0:5942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1783946906.337749:0:3449:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783946906.337755:0:3449:0:(import.c:65:import_set_state_nolock()) ffff9137b63dc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783946906.337759:0:3449:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1783946906.340642:0:3447:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1783946906.365306:0:5943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3449:x1870603523026304:12345-0@lo:103:ldlm_bl.0 Request processed in 32530us (32754us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783946906.365323:0:5943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1783946906.370297:0:3449:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.118@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783946906.370303:0:3449:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783946906.370315:0:3449:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9137be93e680 x1870603523025280/t0(0) o400->MGC192.168.201.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783946913 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946906.370343:0:3449:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9137be845500 x1870603523025920/t0(0) o400->MGC192.168.201.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783946918 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946906.370354:0:3449:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9137be8b3800 x1870603523026304/t0(0) o103->MGC192.168.201.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783946922 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946906.370363:0:3449:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9137be8b3b80 x1870603523026432/t0(0) o103->MGC192.168.201.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783946922 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946906.370373:0:3449:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9137be8b2a00 x1870603523026560/t0(0) o103->MGC192.168.201.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783946922 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783946906.370381:0:3449:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783946906.370384:0:3449:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783946906.370386:0:3449:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783946906.370594:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b032bb55-8d94-4093-96f3-a2f6fadccf82:3450:1870603523025280:0@lo:400:kworker.0 00000100:00080000:3.0:1783946906.370686:0:3447:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9137b63dc800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1783946906.370701:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523025920:0@lo:400:kworker.0 00000100:00100000:3.0:1783946906.370726:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b032bb55-8d94-4093-96f3-a2f6fadccf82:3447:1870603523026560:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1783946906.371429:0:3449:0:(import.c:65:import_set_state_nolock()) ffff9137b63dc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783946906.371438:0:3449:0:(import.c:510:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 220 00000100:00080000:0.0:1783946906.371449:0:3449:0:(import.c:624:import_select_connection()) MGC192.168.201.118@tcp: import ffff9137b63dc800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946906.378024:0:3449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be945880 x1870603523026688/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783946906.379581:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b032bb55-8d94-4093-96f3-a2f6fadccf82:3446:1870603523026688:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1783946906.379640:0:3446:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870603523026688 offset 0 length 520: 4 00000100:00100000:2.0:1783946906.379719:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523026304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783946906.379738:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b032bb55-8d94-4093-96f3-a2f6fadccf82:3449:1870603523026432:0@lo:103:ldlm_bl.0 00100000:10000000:2.0:1783946906.388755:0:13509:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783946906.415100:0:13509:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db70a9 00000020:00000080:0.0:1783946906.415115:0:13509:0:(genops.c:906:class_export_put()) final put ffff9137a7c08000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1783946906.415148:0:13509:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9137b63de800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1783946906.415167:0:13509:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9137b63de800 2 00000020:01000004:0.0:1783946906.415171:0:13509:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9137b63de800 from lustre-OST0000 00000020:00000080:0.0:1783946906.415216:0:13509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783946906.415249:0:13509:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1783946906.415252:0:13509:0:(genops.c:906:class_export_put()) final put ffff9137a7c0d800/lustre-OST0000_UUID 00000020:00000080:0.0:1783946906.415255:0:13509:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a7c0d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1783946906.415271:0:13509:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1783946906.415384:0:13509:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1783946906.415389:0:13509:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783946906.415398:0:13509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783946906.415403:0:13509:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783946906.415410:0:13509:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9137a7eef000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783946906.415423:0:13509:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff913792764d40) has exports, disconnecting them 00000020:00080000:0.0:1783946906.415428:0:13509:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9137a7eef000), last request at 1783946643 00000020:00000080:0.0:1783946906.415432:0:13509:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db70d3 00000020:00080000:0.0:1783946906.415444:0:13509:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9137a7eef000): rc 0 00000020:00000080:0.0:1783946906.415448:0:13509:0:(genops.c:906:class_export_put()) final put ffff9137a7eef000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783946906.415891:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a7c08000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783946906.415901:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a7eef000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1783946906.416867:0:13509:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783946906.416873:0:13509:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783946906.416877:0:13509:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783946906.416883:0:13509:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783946906.416903:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137a7eee000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783946906.417004:0:13509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783946906.417011:0:13509:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1783946906.417017:0:13509:0:(genops.c:906:class_export_put()) final put ffff9137a6b71000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1783946906.417020:0:13509:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a6b71000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1783946906.417024:0:13509:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1783946906.417093:0:13509:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9137b63de800 1 00000020:00000080:1.0:1783946906.417097:0:13509:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7063 00000020:00000080:1.0:1783946906.417101:0:13509:0:(genops.c:906:class_export_put()) final put ffff9137b9cdc800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783946906.417108:0:13509:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783946906.417114:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b9cdc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783946906.417121:0:13509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783946906.417125:0:13509:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783946906.417128:0:13509:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9137b9cfb380) has no exports 00000020:00000080:0.0:1783946906.740635:0:13509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783946906.740649:0:13509:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1783946906.740656:0:13509:0:(genops.c:906:class_export_put()) final put ffff9137b6553000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1783946906.740660:0:13509:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b6553000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1783946906.740672:0:13509:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1783946906.740780:0:13509:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9137b63da800 00000020:02000400:0.0:1783946906.740826:0:13509:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783946906.896656:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783946907.537284:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) b032bb55-8d94-4093-96f3-a2f6fadccf82->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783946907.537315:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) b032bb55-8d94-4093-96f3-a2f6fadccf82->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783946907.537318:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783946907.537322:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1783946907.935097:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946908.945366:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946909.972763:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946910.996414:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783946911.568323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) b032bb55-8d94-4093-96f3-a2f6fadccf82->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783946911.568337:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) b032bb55-8d94-4093-96f3-a2f6fadccf82->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783946911.568352:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783946911.568356:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1783946912.016367:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783946912.050547:0:13710:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783946912.063330:0:13710:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1783946912.063425:0:13710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.063442:0:13710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.063449:0:13710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.063456:0:13710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.063482:0:13710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783946912.063488:0:13710:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783946912.063516:0:13710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783946912.063539:0:13710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9137be8b0380 x1870603523026176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783946917 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783946912.063547:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946912.063562:0:5945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.063578:0:5945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622800 already unused, calling callback (ffffffffc1499c20) 00000100:00100000:2.0:1783946912.063581:0:13710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:00010000:3.0:1783946912.063585:0:5945:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.063599:0:5945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946912.063607:0:5945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946912.063614:0:5945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:2.0:1783946912.063616:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137be1a8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 10000000:01000000:3.0:1783946912.063630:0:5945:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783946912.063636:0:5945:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1783946912.063636:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1783946912.063647:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3446:1870603523026176:0@lo:38:kworker.0 00010000:00010000:3.0:1783946912.063667:0:5945:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9137b63dc800 00010000:00010000:3.0:1783946912.063674:0:5945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.063683:0:5945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db7270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x229d2ec450db7277 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783946912.063685:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) b032bb55-8d94-4093-96f3-a2f6fadccf82->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783946912.063700:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) b032bb55-8d94-4093-96f3-a2f6fadccf82->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783946912.063712:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946912.063716:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946912.063719:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783946912.063720:0:13710:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783946912.063727:0:13710:0:(import.c:65:import_set_state_nolock()) ffff9137be1a8000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1783946912.063734:0:13710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783946912.063736:0:13710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783946912.063740:0:13710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783946912.064649:0:13710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.064662:0:13710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.064669:0:13710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.064675:0:13710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.064692:0:13710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946912.064699:0:13710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.064718:0:13710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.064723:0:13710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.064729:0:13710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.064739:0:13710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783946912.064742:0:13710:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1783946912.064766:0:13710:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1783946912.064770:0:13710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1783946912.064776:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783946912.064782:0:13710:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783946912.064786:0:13710:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9137b9cf99c0) has no exports 00000020:00080000:2.0:1783946912.064811:0:13710:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9137b9cf99c0) has no exports 00010000:00010000:3.0:1783946912.066072:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783946912.066098:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.066110:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45a00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946912.066116:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.066139:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946912.066148:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946912.066155:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783946912.066226:0:5944:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1783946912.066230:0:5944:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1783946912.066255:0:5944:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9137b63dc800 00010000:00010000:3.0:1783946912.066260:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.066268:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137b9f45a00/0x229d2ec450db727e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x229d2ec450db7285 expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.066282:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946912.066287:0:5944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.066293:0:5944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623400 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946912.066296:0:5944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.066314:0:5944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946912.066321:0:5944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946912.066326:0:5944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783946912.066329:0:5944:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783946912.066331:0:5944:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783946912.066339:0:5944:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9137b63dc800 00010000:00010000:3.0:1783946912.066342:0:5944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.066349:0:5944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db74c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x229d2ec450db74ca expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946912.066364:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946912.066366:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946912.066368:0:5944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946912.066378:0:5945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783946912.069196:0:13710:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9137a423af00 - data ffff9137901760d8/ffff9137be3a6800 00000020:01000000:2.0:1783946912.069378:0:13710:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9137a5f8e5a0 - data ffff9137900356c0/ffff9137bdecc400 00100000:10000000:3.0:1783946912.094999:0:13710:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783946912.103678:0:13710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7174 00000020:00000080:2.0:1783946912.103696:0:13710:0:(genops.c:906:class_export_put()) final put ffff9137bdf74800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1783946912.103759:0:13710:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9137a7c0f800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1783946912.103933:0:13710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9137a7c0f800 2 00000020:01000004:2.0:1783946912.103938:0:13710:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9137a7c0f800 from lustre-OST0001 00000020:00000080:2.0:1783946912.103977:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783946912.103990:0:13710:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1783946912.103994:0:13710:0:(genops.c:906:class_export_put()) final put ffff9137a4a0e000/lustre-OST0001_UUID 00000020:00000080:2.0:1783946912.103998:0:13710:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a4a0e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1783946912.104006:0:13710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1783946912.104198:0:13710:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b032bb55-8d94-4093-96f3-a2f6fadccf82->MGS 00010000:00010000:2.0:1783946912.104218:0:13710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db708d expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946912.104231:0:13710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db708d expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946912.104239:0:13710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1783946912.104242:0:13710:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1783946912.104246:0:13710:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1783946912.104270:0:13710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9137b63dc800 00010000:00010000:2.0:1783946912.104275:0:13710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137c21d5400/0x229d2ec450db7086 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x229d2ec450db708d expref: -99 pid: 6936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946912.104296:0:13710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x229d2ec450db72cb expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946912.104303:0:13710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x229d2ec450db72cb expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946912.104308:0:13710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783946912.104310:0:13710:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1783946912.104312:0:13710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1783946912.104322:0:13710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9137b63dc800 00010000:00010000:2.0:1783946912.104325:0:13710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137a35bf600/0x229d2ec450db72c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x229d2ec450db72cb expref: -99 pid: 5953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783946912.104344:0:13710:0:(import.c:65:import_set_state_nolock()) ffff9137b63dc800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1783946912.104349:0:13710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783946912.104352:0:13710:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783946912.104354:0:13710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783946912.104359:0:13710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783946912.104378:0:13710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9137be945880 x1870603523026688/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783946916 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783946912.104398:0:13710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783946912.104402:0:13710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:1.0:1783946912.104499:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b032bb55-8d94-4093-96f3-a2f6fadccf82:3446:1870603523026688:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1783946912.104564:0:13710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783946912.104572:0:13710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db6f67 00000020:00000080:2.0:1783946912.104577:0:13710:0:(genops.c:906:class_export_put()) final put ffff9137b63da000/b032bb55-8d94-4093-96f3-a2f6fadccf82 00000020:00000080:0.0:1783946912.110465:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137bdf74800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783946912.113523:0:13710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.118@tcp (flags='') 00000020:00000080:2.0:1783946912.113542:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783946912.113558:0:13710:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.118@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783946912.113566:0:13710:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9137909d0000) has no exports 10000000:01000000:2.0:1783946912.113603:0:5953:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1783946912.113706:0:13710:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.118@tcp: client import never connected 00000100:00080000:2.0:1783946912.113712:0:13710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1783946912.113716:0:13710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783946912.113721:0:13710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1783946912.113724:0:13710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783946912.113783:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783946912.113791:0:13710:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.118@tcp (uuid b032bb55-8d94-4093-96f3-a2f6fadccf82) 00000020:01000000:2.0:1783946912.113799:0:13710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783946912.113802:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783946912.113806:0:13710:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783946912.113815:0:13710:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9137be1ac800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783946912.113821:0:13710:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9137b65e4d40) has exports, disconnecting them 00000020:00080000:2.0:1783946912.113826:0:13710:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9137be1ac800), last request at 1783946666 00000020:00000080:2.0:1783946912.113832:0:13710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db719e 00000020:00080000:2.0:1783946912.113851:0:13710:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9137be1ac800): rc 0 00000020:00000080:2.0:1783946912.113856:0:13710:0:(genops.c:906:class_export_put()) final put ffff9137be1ac800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783946912.114373:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b63da000/b032bb55-8d94-4093-96f3-a2f6fadccf82 for MGC192.168.201.118@tcp 00000020:00000080:0.0:1783946912.114388:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137b63dc800 for MGC192.168.201.118@tcp 00000020:00000080:0.0:1783946912.114397:0:38:0:(genops.c:906:class_export_put()) final put ffff9137b63d9800/b032bb55-8d94-4093-96f3-a2f6fadccf82 00000020:00000080:0.0:1783946912.114399:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b63d9800/b032bb55-8d94-4093-96f3-a2f6fadccf82 for MGC192.168.201.118@tcp 00000020:01000000:0.0:1783946912.114405:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.118@tcp (b032bb55-8d94-4093-96f3-a2f6fadccf82) 00000020:00000080:0.0:1783946912.114748:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137be1ac800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1783946912.120265:0:13710:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783946912.120279:0:13710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783946912.120284:0:13710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783946912.120295:0:13710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783946912.120431:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9137be1a8000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1783946912.129211:0:5944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1783946912.129473:0:5945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1783946912.129787:0:5940:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9137a06c5000:5940] 1 exiting: rc = 0 00000100:00100000:0.0:1783946912.133355:0:5939:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91379d65de00:5939] 0 exiting: rc = 1 00000100:00100000:1.0:1783946912.133533:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.133889:0:5941:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9137a06c5800:5941] 0 exiting: rc = 1 00000100:00100000:0.0:1783946912.134111:0:5942:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9137a06c5a00:5942] 1 exiting: rc = 0 00000100:00100000:2.0:1783946912.134343:0:8023:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9137b9ef2a00:8023] 3 exiting: rc = 0 00000100:00100000:2.0:1783946912.134856:0:5943:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9137a06c4400:5943] 2 exiting: rc = 0 00000100:00100000:1.0:1783946912.134950:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.134959:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.134966:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.134972:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.134979:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.134987:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.134994:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135002:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135008:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135015:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135022:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135028:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135036:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135044:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135052:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135092:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135101:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135108:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135114:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135120:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135135:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135160:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135166:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135172:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135178:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135184:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135190:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135195:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135203:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135210:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135217:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135223:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135230:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135235:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135240:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135255:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135262:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135269:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135277:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135285:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135295:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135302:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135312:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135319:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135326:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135334:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135341:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135351:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135359:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135379:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135386:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135392:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135397:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135403:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135409:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135414:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135428:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135434:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135440:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135446:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135453:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135459:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135465:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.135470:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783946912.136717:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783946912.136733:0:13710:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1783946912.136740:0:13710:0:(genops.c:906:class_export_put()) final put ffff9137b9ca2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1783946912.136745:0:13710:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b9ca2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1783946912.136751:0:13710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1783946912.136829:0:13710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9137a7c0f800 1 00000020:00000080:1.0:1783946912.136836:0:13710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x229d2ec450db7143 00000020:00000080:1.0:1783946912.136844:0:13710:0:(genops.c:906:class_export_put()) final put ffff9137bdc1c000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1783946912.136865:0:13710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1783946912.136879:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9137bdc1c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1783946912.136893:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783946912.136899:0:13710:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783946912.136903:0:13710:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9137a07319c0) has no exports 00000020:00000080:1.0:1783946912.287275:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783946912.287296:0:13710:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1783946912.287303:0:13710:0:(genops.c:906:class_export_put()) final put ffff9137a7c0f000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1783946912.287309:0:13710:0:(genops.c:865:class_export_destroy()) destroying export ffff9137a7c0f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1783946912.287320:0:13710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1783946912.288688:0:13710:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9137a7c08800 00000020:01000000:1.0:1783946912.288721:0:13710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1783946912.288729:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783946912.288735:0:13710:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783946912.288741:0:13710:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9137b65e19c0) has no exports 00000020:00000080:1.0:1783946912.288776:0:13710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783946912.288799:0:13710:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1783946912.288803:0:13710:0:(genops.c:906:class_export_put()) final put ffff9137b9cdc000/OSS_uuid 00000020:00000080:1.0:1783946912.288806:0:13710:0:(genops.c:865:class_export_destroy()) destroying export ffff9137b9cdc000/OSS_uuid for OSS 00000020:01000000:1.0:1783946912.288811:0:13710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1783946912.289412:0:5952:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1783946912.295001:0:9002:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9137b9fed400:9002] 3 exiting: rc = 0 00000100:00100000:2.0:1783946912.295570:0:6945:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff913791bb3000:6945] 2 exiting: rc = 0 00000100:00100000:1.0:1783946912.295794:0:6944:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff913791bb3800:6944] 1 exiting: rc = 0 00000100:00100000:3.0:1783946912.306135:0:6942:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff913791bb3600:6942] 0 exiting: rc = 1 00000100:00100000:0.0:1783946912.306532:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306543:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306551:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306561:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306567:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306573:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306580:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306586:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306609:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306615:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306620:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306625:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306630:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306636:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306642:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306647:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306654:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306661:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306667:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306674:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306680:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306693:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306702:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306710:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306718:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306723:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306729:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306736:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306742:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306751:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306756:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306772:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306778:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306784:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306790:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306796:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306803:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306809:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306815:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306820:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306827:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306832:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306838:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306862:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306869:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306875:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306881:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306887:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306893:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306900:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306906:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306914:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306919:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306924:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306929:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306935:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306941:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306946:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306952:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306958:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306964:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306970:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306975:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.306981:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.308503:0:6947:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9137a5d30200:6947] 1 exiting: rc = 0 00000100:00100000:1.0:1783946912.308858:0:6946:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff913797bbc800:6946] 0 exiting: rc = 1 00000100:00100000:0.0:1783946912.310257:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310270:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310276:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310282:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310287:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310294:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310301:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310306:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310311:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310317:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310323:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310329:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310335:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310339:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310359:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310366:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310373:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310378:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310385:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310391:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310396:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310402:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310408:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310413:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310419:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310425:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310431:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310436:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310442:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310448:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310454:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310460:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310466:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310472:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310477:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310483:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310489:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310495:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310501:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310507:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310513:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310519:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310525:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310531:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310537:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310542:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310547:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310552:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310559:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310570:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310576:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310582:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310588:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310593:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310600:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310606:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310611:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310617:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310623:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310629:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310634:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310640:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310645:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.310651:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.311798:0:6949:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9137927ba200:6949] 1 exiting: rc = 0 00000100:00100000:2.0:1783946912.312454:0:6948:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9137927bb600:6948] 0 exiting: rc = 1 00000100:00100000:0.0:1783946912.320405:0:6950:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9137927bb200:6950] 2 exiting: rc = 0 00000100:00100000:2.0:1783946912.320664:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320674:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320681:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320687:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320693:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320699:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320706:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320712:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320718:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320726:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320751:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320759:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320766:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320772:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320778:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320785:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320791:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320797:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320805:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320811:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320817:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320824:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320830:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320835:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320841:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320847:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320854:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320860:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320867:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320875:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320893:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320899:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320905:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320932:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320957:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320964:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320971:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320978:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320984:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320990:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.320995:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321001:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321007:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321014:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321020:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321027:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321032:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321039:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321044:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321051:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321076:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321084:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321090:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321096:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321103:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321109:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321116:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321122:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321141:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321147:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321153:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321160:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321166:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.321182:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783946912.327377:0:6951:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9137a5d31800:6951] 0 exiting: rc = 1 00000100:00100000:1.0:1783946912.327405:0:6952:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9137a5d30600:6952] 1 exiting: rc = 0 00000100:00100000:1.0:1783946912.327552:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327562:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327568:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327575:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327581:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327587:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327594:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327599:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327605:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327611:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327619:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327626:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327633:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327639:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327645:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327653:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327662:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327669:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327677:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327686:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327691:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327697:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327704:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327709:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327716:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327722:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327746:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327752:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.327757:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.330935:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.330954:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.330960:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.330966:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.330972:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.330977:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.330984:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.330991:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.330997:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331003:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331009:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331015:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331021:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331027:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331032:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331039:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331044:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331050:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331056:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331079:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331086:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331093:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331100:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331106:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331111:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331116:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331122:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331139:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331145:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331150:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331156:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331162:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331194:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331200:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.331206:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783946912.332180:0:6953:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9137b9ddb400:6953] 0 exiting: rc = 1 00000100:00100000:0.0:1783946912.332338:0:6954:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9137a5d3a800:6954] 1 exiting: rc = 0 00000100:00100000:1.0:1783946912.332942:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.332953:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.332960:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.332969:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.332976:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.332983:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.332990:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.332998:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333005:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333012:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333019:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333026:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333048:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333081:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333089:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333097:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333109:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333120:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333141:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333152:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333160:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333167:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333174:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333182:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333209:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333219:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333225:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333237:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333246:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333253:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333261:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333270:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333291:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333300:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333308:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333316:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333342:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333352:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333360:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.333367:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334513:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334522:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334529:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334536:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334546:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334553:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334560:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334568:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334601:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334609:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334615:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334622:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334629:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334638:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334646:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334654:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334662:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334669:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334676:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334683:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334707:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334716:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334723:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783946912.334730:0:13710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783946912.366777:0:13710:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1783946934.400660:0:14371:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783946947.045969:0:14970:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783946947.045976:0:14970:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783946947.045978:0:14970:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783946947.046235:0:14970:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff913791b89000 00000020:01000004:0.0:1783946947.046250:0:14970:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783946947.046257:0:14970:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783946947.046458:0:14970:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9137b65e19c0) 00000020:00000080:0.0:1783946947.046474:0:14970:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783946947.126029:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783946947.127098:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783946947.129514:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1783946947.129874:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783946947.130818:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783946947.131099:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783946947.131387:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783946947.131607:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783946947.131801:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783946947.132034:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783946947.132456:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783946947.132662:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783946947.133017:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783946947.133232:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783946947.133810:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783946947.135630:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.135858:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.136347:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.136606:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.136832:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.138253:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.139243:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.139594:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.139855:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.140171:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.140526:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.140792:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.141212:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.141641:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.141987:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.142890:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.143332:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.143524:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.143785:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.144928:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.146145:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.146489:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.146905:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.147886:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.148220:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.148661:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.148873:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.149899:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.150442:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.154035:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783946947.155681:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783946947.156387:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783946947.162551:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783946947.163737:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1783946947.166665:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783946947.168713:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783946947.169426:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783946947.170139:0:14970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1783946947.172739:0:14970:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783946947.173014:0:14970:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783946947.173023:0:14970:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783946947.173037:0:14970:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db82bc 00000020:01000004:3.0:1783946947.174350:0:14970:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783946947.174357:0:14970:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783946947.174368:0:14970:0:(tgt_mount.c:101:server_register_mount()) register mount ffff913791b89000 from MGS 00000020:01000004:3.0:1783946947.174372:0:14970:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783946947.174385:0:14970:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff913792760000) 00000020:00000080:3.0:1783946947.174401:0:14970:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783946947.174476:0:14970:0:(tgt_mount.c:153:server_get_mount()) get mount ffff913791b89000 from MGS, refs=2 00080000:01000000:3.0:1783946947.174494:0:14970:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783946947.174500:0:14970:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db82ca 00000100:00100000:3.0:1783946947.174666:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783946947.174784:0:14970:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783946947.174790:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783946947.176668:0:14970:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783946947.176680:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783946947.178538:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783946947.178968:0:14970:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783946947.178974:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783946947.180451:0:14970:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783946947.180463:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783946947.193797:0:14970:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783946947.193820:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783946947.196839:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946947.196845:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946947.196847:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946947.197966:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946947.197970:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946947.197972:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946947.203475:0:14970:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783946947.209456:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783946947.217442:0:14970:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783946947.229284:0:14983:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783946947.229555:0:14970:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783946947.229753:0:14970:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783946947.230908:0:14970:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783946947.232094:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783946947.232250:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783946947.232811:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783946947.239618:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783946947.239633:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783946947.240934:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783946947.240948:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783946947.242209:0:14970:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783946947.242244:0:14970:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.118@tcp' 00000020:01000004:3.0:1783946947.242246:0:14970:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783946947.242498:0:14970:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.118@tcp (typ=mgc) 00000020:00000080:3.0:1783946947.242512:0:14970:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.118@tcp (ffff913792763380) 00000020:00000080:3.0:1783946947.242536:0:14970:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783946947.242625:0:14970:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9137a07eb000@MGC192.168.201.118@tcp: add connection 192.168.201.118@tcp at head 00010000:00010000:3.0:1783946947.242785:0:14970:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.118@tcp-0 is initialized 00000040:01000000:3.0:1783946947.242792:0:14970:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 1 is initialized 00000100:00080000:0.0:1783946947.246808:0:14987:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1783946947.247149:0:14988:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783946947.247229:0:14970:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.118@tcp (uuid 39c72ff9-53ed-483b-b87f-ab321f5fef71) 00000020:00000080:1.0:1783946947.247253:0:14970:0:(genops.c:1406:class_connect()) connect: client 39c72ff9-53ed-483b-b87f-ab321f5fef71, cookie 0x229d2ec450db82d8 00000100:00080000:1.0:1783946947.247277:0:14970:0:(import.c:510:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783946947.247283:0:14970:0:(import.c:624:import_select_connection()) MGC192.168.201.118@tcp: import ffff9137a07eb000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946947.247317:0:14970:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be93e680 x1870603523026816/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783946947.247348:0:14970:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 39c72ff9-53ed-483b-b87f-ab321f5fef71->MGS 00000020:01000004:1.0:1783946947.247369:0:14970:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783946947.247374:0:14970:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783946947.247388:0:14970:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9137b9cfcd40) 00000020:00000080:1.0:1783946947.247404:0:14970:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783946947.247704:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39c72ff9-53ed-483b-b87f-ab321f5fef71:3446:1870603523026816:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783946947.247770:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946947.247958:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523026816 00000100:00100000:0.0:1783946947.247966:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523026816 00000100:00100000:0.0:1783946947.247994:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946947.248009:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913798483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3446:x1870603523026816:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783946947.248031:0:14984:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 39c72ff9-53ed-483b-b87f-ab321f5fef71@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:0.0:1783946947.248050:0:14984:0:(genops.c:1406:class_connect()) connect: client 39c72ff9-53ed-483b-b87f-ab321f5fef71, cookie 0x229d2ec450db82e6 00000100:00080000:0.0:1783946947.248206:0:14984:0:(import.c:65:import_set_state_nolock()) ffff9137b65d9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783946947.248274:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913798483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+5:3446:x1870603523026816:12345-0@lo:250:mount.lustre.0 Request processed in 265us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946947.248282:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783946947.248900:0:3446:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783946947.248909:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.118@tcp: connect to target with instance 0 00000100:00080000:3.0:1783946947.248916:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783946947.248920:0:3446:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783946947.248924:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137a07eb000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783946947.248926:0:3446:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783946947.248943:0:3446:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783946947.248949:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39c72ff9-53ed-483b-b87f-ab321f5fef71:3446:1870603523026816:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783946947.269780:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946947.269983:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1783946947.269989:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783946947.272038:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783946947.272050:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783946947.272458:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783946947.272465:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783946947.273296:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946947.273452:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783946947.273457:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783946947.282596:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783946947.282611:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783946947.348509:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946947.348718:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783946947.348726:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783946947.356485:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783946947.356625:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783946947.357879:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783946947.358438:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783946947.358445:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783946947.359394:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783946947.359405:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783946947.360039:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783946947.360434:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783946947.360440:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783946947.361054:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783946947.361342:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783946947.362010:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783946947.362538:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783946947.362544:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783946947.363370:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783946947.363377:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783946947.401571:0:14970:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783946947.402331:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783946947.402339:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783946947.412564:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783946947.412581:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783946947.414006:0:14970:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783946947.414018:0:14970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783946947.415320:0:14970:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783946947.415353:0:14970:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783946947.415359:0:14970:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783946947.415469:0:14970:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783946947.415505:0:14970:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783946947.415510:0:14970:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783946947.415511:0:14970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783946947.415512:0:14970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783946947.415520:0:14970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783946947.415521:0:14970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783946947.415522:0:14970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783946947.415523:0:14970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783946947.415533:0:14970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783946947.415535:0:14970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783946947.415537:0:14970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783946947.415539:0:14970:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783946947.415541:0:14970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783946947.415542:0:14970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783946947.415543:0:14970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783946947.415544:0:14970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783946947.415545:0:14970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783946947.415546:0:14970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783946947.415546:0:14970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783946947.415547:0:14970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783946947.415548:0:14970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783946947.415549:0:14970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783946947.415577:0:14970:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783946947.415599:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523026944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783946947.415685:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946947.415905:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523026944 00000100:00100000:2.0:1783946947.415914:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523026944 00000100:00100000:2.0:1783946947.415969:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946947.415979:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913798483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+5:14970:x1870603523026944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783946947.416024:0:14986:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783946947.416027:0:14986:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783946947.416029:0:14986:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:2.0:1783946947.416565:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798813480 going to sleep for 11 seconds 10000000:01000000:0.0:1783946947.416686:0:15007:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783946947.419083:0:14986:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1783946947.424792:0:15008:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783946947.424801:0:15008:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783946947.424804:0:15008:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783946947.424814:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1783946947.425053:0:14986:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783946947.425085:0:14986:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783946947.427764:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913798483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+5:14970:x1870603523026944:12345-0@lo:253:mount.lustre.0 Request processed in 11779us (12071us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946947.427780:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946947.427890:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523026944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783946947.427917:0:14970:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783946947.427921:0:14970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783946947.427923:0:14970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783946947.427924:0:14970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946947.427925:0:14970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946947.427927:0:14970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946947.427928:0:14970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946947.427929:0:14970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783946947.427931:0:14970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783946947.427934:0:14970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946947.427935:0:14970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783946947.427962:0:14970:0:(tgt_mount.c:101:server_register_mount()) register mount ffff913791b89000 from lustre-MDT0000 10000000:01000000:2.0:1783946947.427990:0:14970:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783946947.427993:0:14970:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783946947.428011:0:14970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff913792763380 10000000:01000000:2.0:1783946947.428015:0:14970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783946947.428024:0:14970:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff913792763380 from 1 10000000:01000000:2.0:1783946947.428027:0:14970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783946947.428092:0:14970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.428103:0:14970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.428114:0:14970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946947.428134:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783946947.428180:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946947.428207:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a07393c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946947.428438:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523027072 00000100:00100000:0.0:1783946947.428445:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523027072 00000100:00100000:0.0:1783946947.428485:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946947.428494:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913798482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+5:14970:x1870603523027072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783946947.428505:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946947.428519:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137be3a8e00/0x229d2ec450db82f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db82ed expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.428571:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137be3a8e00/0x229d2ec450db82f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db82ed expref: 6 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.428582:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137be3a8e00/0x229d2ec450db82f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db82ed expref: 6 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.428591:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8e00, rc 0) 00000100:00100000:0.0:1783946947.428628:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913798482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+6:14970:x1870603523027072:12345-0@lo:101:mount.lustre.0 Request processed in 135us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946947.428634:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783946947.428699:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783946947.428711:0:14970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.428721:0:14970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946947.428770:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783946947.428794:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946947.428821:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a07393c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946947.428868:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523027200 00000100:00100000:0.0:1783946947.428873:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523027200 00000100:00100000:0.0:1783946947.428946:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783946947.428954:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913798480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+6:14970:x1870603523027200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783946947.429027:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913798480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+6:14970:x1870603523027200:12345-0@lo:501:mount.lustre.0 Request processed in 74us (232us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783946947.429034:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946947.429100:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027200:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783946947.429128:0:14970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783946947.429157:0:14970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.429173:0:14970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946947.429180:0:14970:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff913791b89000 10000000:01000000:2.0:1783946947.429185:0:14970:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783946947.429189:0:14970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff913791b89000 10000000:01000000:2.0:1783946947.429192:0:14970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783946947.429194:0:14970:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff913791b89000 from 1 10000000:01000000:2.0:1783946947.429196:0:14970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783946947.429211:0:14970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9e00/0x229d2ec450db82fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.429218:0:14970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137bdca9e00/0x229d2ec450db82fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.429225:0:14970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137bdca9e00/0x229d2ec450db82fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946947.429236:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783946947.429271:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946947.433901:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a07393c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946947.434427:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523027328 00000100:00100000:3.0:1783946947.434438:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523027328 00000100:00100000:2.0:1783946947.434565:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783946947.434576:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+6:14970:x1870603523027328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783946947.434596:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946947.434619:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137bdca9a00/0x229d2ec450db8302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db82fb expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.434672:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137bdca9a00/0x229d2ec450db8302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db82fb expref: 7 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.434684:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137bdca9a00/0x229d2ec450db8302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db82fb expref: 7 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.434693:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9a00, rc 0) 00000100:00100000:2.0:1783946947.434775:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+7:14970:x1870603523027328:12345-0@lo:101:mount.lustre.0 Request processed in 201us (5503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946947.434782:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783946947.434883:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783946947.434965:0:14970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137bdca9e00/0x229d2ec450db82fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8302 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.434982:0:14970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137bdca9e00/0x229d2ec450db82fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db8302 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946947.435002:0:14970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783946947.435022:0:14970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9e00/0x229d2ec450db82fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8302 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.435029:0:14970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137bdca9e00/0x229d2ec450db82fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8302 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946947.435037:0:14970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783946947.435042:0:14970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783946947.435048:0:14970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff913791b89000 10000000:01000000:3.0:1783946947.435050:0:14970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783946947.435055:0:14970:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783946947.435089:0:14970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783946947.435119:0:14970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030600/0x229d2ec450db8309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.435127:0:14970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913780030600/0x229d2ec450db8309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.435135:0:14970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913780030600/0x229d2ec450db8309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946947.435158:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783946947.435205:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946947.435227:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137812edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946947.435550:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523027456 00000100:00100000:0.0:1783946947.435556:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523027456 00000100:00100000:1.0:1783946947.435748:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783946947.435757:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+7:14970:x1870603523027456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783946947.435767:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946947.435779:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f45600/0x229d2ec450db8310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8309 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.435798:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f45600/0x229d2ec450db8310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8309 expref: 8 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.435806:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f45600/0x229d2ec450db8310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8309 expref: 8 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.435825:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45600, rc 0) 00000100:00100000:1.0:1783946947.435872:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+8:14970:x1870603523027456:12345-0@lo:101:mount.lustre.0 Request processed in 115us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946947.435879:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783946947.435958:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783946947.435970:0:14970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913780030600/0x229d2ec450db8309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8310 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.435979:0:14970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913780030600/0x229d2ec450db8309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db8310 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946947.436038:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783946947.436096:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946947.439814:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137812edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946947.439881:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523027584 00000100:00100000:2.0:1783946947.439890:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523027584 00000100:00100000:2.0:1783946947.440038:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783946947.440048:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+8:14970:x1870603523027584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783946947.440463:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+9:14970:x1870603523027584:12345-0@lo:501:mount.lustre.0 Request processed in 416us (4365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946947.440473:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783946947.440623:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783946947.440676:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783946947.440738:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946947.440797:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137812edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946947.440836:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523027712 00000100:00100000:0.0:1783946947.440840:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523027712 00000100:00100000:0.0:1783946947.440965:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783946947.440975:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+9:14970:x1870603523027712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783946947.441869:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+9:14970:x1870603523027712:12345-0@lo:503:mount.lustre.0 Request processed in 891us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946947.441877:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783946947.442009:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523027712:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783946947.459250:0:15009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be845180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15009:1870603523027840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946947.459364:0:15009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946947.459428:0:15009:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0739c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783946947.460021:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523027840 00000100:00100000:3.0:1783946947.460030:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523027840 00000100:00100000:3.0:1783946947.460112:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783946947.460123:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+9:15009:x1870603523027840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946947.460962:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+9:15009:x1870603523027840:12345-0@lo:502:llog_process_th.0 Request processed in 838us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946947.460971:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783946947.461103:0:15009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be845180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15009:1870603523027840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783946947.461138:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783946947.461150:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946947.461152:0:15009:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783946947.461157:0:15009:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783946947.461160:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783946947.461180:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9137a0730000) 00000020:00000080:2.0:1783946947.461197:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783946947.461203:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783946947.461299:0:15009:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783946947.461308:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db831e 00000020:00000080:2.0:1783946947.461551:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783946947.461564:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783946947.461569:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946947.461570:0:15009:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783946947.461573:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783946947.461576:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946947.461578:0:15009:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783946947.461581:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783946947.461589:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9137a0734d40) 00000020:00000080:2.0:1783946947.461600:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783946947.461603:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783946947.461605:0:15009:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783946947.461608:0:15009:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783946947.461613:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783946947.461657:0:15009:0:(tgt_mount.c:153:server_get_mount()) get mount ffff913791b89000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783946947.461669:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9137a07319c0) 00000020:00000080:2.0:1783946947.461677:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783946947.461738:0:15009:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783946947.461745:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db8333 00000020:00000080:2.0:1783946947.461835:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783946947.461842:0:15009:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783946947.461846:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x229d2ec450db833a 00080000:01000000:2.0:1783946947.461851:0:15009:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783946947.461855:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db8341 00010000:00010000:2.0:1783946947.543904:0:15009:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783946947.545193:0:15009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1783946947.545757:0:15009:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783946947.546274:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9137a0733380) 00000020:00000080:2.0:1783946947.546302:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783946947.546366:0:15009:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783946947.546373:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db834f 00000020:00000080:3.0:1783946947.548794:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783946947.565193:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x229d2ec450db8356 00000020:00000080:2.0:1783946947.566483:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783946947.566497:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783946947.566506:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946947.566508:0:15009:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783946947.566511:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783946947.566514:0:15009:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1783946947.566516:0:15009:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783946947.566517:0:15009:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783946947.566519:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783946947.566530:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946947.566532:0:15009:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783946947.566535:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783946947.566541:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946947.566542:0:15009:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783946947.566547:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783946947.566781:0:15009:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783946947.566799:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783946947.566803:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946947.566804:0:15009:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783946947.566807:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783946947.566810:0:15009:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783946947.566813:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946947.566814:0:15009:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783946947.566817:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783946947.566822:0:15009:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:2.0:1783946947.566847:0:15009:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783946947.566850:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783946947.566881:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9137ba318000) 00000020:00000080:2.0:1783946947.566899:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1783946947.566909:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783946947.566975:0:15009:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783946947.566980:0:15009:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783946947.566987:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db8364 00010000:00080000:2.0:1783946947.567017:0:15009:0:(ldlm_lib.c:102:import_set_conn()) imp ffff913784354000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:2.0:1783946947.573911:0:15009:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1783946947.578262:0:15009:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783946947.579419:0:15009:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783946947.585145:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783946947.586258:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783946947.593054:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783946947.593808:0:15013:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783946947.593813:0:15013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783946947.595000:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783946947.595014:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783946947.595201:0:15009:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783946947.595222:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db836b 00000100:00080000:0.0:1783946947.595233:0:15009:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783946947.595239:0:15009:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff913784354000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946947.595278:0:15009:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be947800 x1870603523027968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783946947.595357:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523027968:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783946947.595411:0:3446:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870603523027968 offset 0 length 520: 4 00000100:00080000:0.0:1783946947.595520:0:15009:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783946947.595700:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946947.595705:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946947.595707:0:15009:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783946947.595710:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783946947.595713:0:15009:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1783946947.595714:0:15009:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783946947.595716:0:15009:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783946947.595718:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783946947.595720:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946947.595722:0:15009:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783946947.595724:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783946947.595728:0:15009:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783946947.595732:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946947.595733:0:15009:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783946947.595737:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783946947.595741:0:15009:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:0.0:1783946947.595764:0:15009:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783946947.595766:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783946947.595779:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9137b65e3380) 00000020:00000080:0.0:1783946947.595790:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783946947.595794:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783946947.595871:0:15009:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783946947.595883:0:15009:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783946947.595889:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x229d2ec450db8379 00010000:00080000:0.0:1783946947.595918:0:15009:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9137b9cdd800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1783946947.596143:0:15009:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1783946947.596211:0:15009:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783946947.596225:0:15009:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783946947.597999:0:15009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783946947.600882:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1783946947.601130:0:15009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1783946947.601979:0:15015:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783946947.601985:0:15015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783946947.603004:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783946947.603019:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783946947.603092:0:15009:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783946947.603115:0:15009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db8380 00000100:00080000:0.0:1783946947.603127:0:15009:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783946947.603133:0:15009:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9137b9cdd800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946947.603172:0:15009:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be946a00 x1870603523028096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783946947.603195:0:15009:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783946947.603254:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946947.603259:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946947.603261:0:15009:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783946947.603264:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946947.603268:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946947.603269:0:15009:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783946947.603272:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783946947.603274:0:15009:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783946947.603276:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946947.603279:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946947.603280:0:15009:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783946947.603282:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946947.603284:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946947.603296:0:15009:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783946947.603301:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783946947.603507:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523028096:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783946947.603782:0:3446:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870603523028096 offset 0 length 520: 4 00000100:00100000:0.0:1783946947.603928:0:15009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15009:1870603523028224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946947.603980:0:15009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946947.604006:0:15009:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786412f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783946947.604091:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523028224 00000100:00100000:1.0:1783946947.604099:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523028224 00000100:00100000:1.0:1783946947.604215:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783946947.604225:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+9:15009:x1870603523028224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783946947.604378:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+9:15009:x1870603523028224:12345-0@lo:502:llog_process_th.0 Request processed in 154us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946947.604387:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783946947.604471:0:15009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15009:1870603523028224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783946947.604500:0:15009:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946947.604506:0:15009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946947.604508:0:15009:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783946947.604512:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1783946947.604893:0:14970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1783946947.604917:0:14970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783946947.604940:0:14970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030600/0x229d2ec450db8309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8310 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.604951:0:14970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913780030600/0x229d2ec450db8309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8310 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946947.604959:0:14970:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff913791b89000 from 1 10000000:01000000:3.0:1783946947.604961:0:14970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783946947.604989:0:14970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.604997:0:14970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.605005:0:14970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946947.605020:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783946947.605053:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946947.611885:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946947.614627:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523028352 00000100:00100000:2.0:1783946947.614643:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523028352 00000100:00100000:2.0:1783946947.615164:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783946947.615177:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+9:14970:x1870603523028352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783946947.615194:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946947.615215:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8387 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.615245:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8387 expref: 10 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.615257:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8387 expref: 10 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946947.615267:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8e00, rc 0) 00000100:00100000:2.0:1783946947.615700:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+10:14970:x1870603523028352:12345-0@lo:101:mount.lustre.0 Request processed in 525us (10645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946947.615708:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783946947.622184:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783946947.622218:0:14970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.622233:0:14970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946947.623848:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028480:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783946947.623929:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946947.623978:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946947.624538:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523028480 00000100:00100000:1.0:1783946947.624547:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523028480 00000100:00100000:1.0:1783946947.624805:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783946947.624818:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+10:14970:x1870603523028480:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783946947.624843:0:14985:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783946947.624849:0:14985:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783946947.625358:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+10:14970:x1870603523028480:12345-0@lo:256:mount.lustre.0 Request processed in 541us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946947.625367:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783946947.626183:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028480:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783946947.628638:0:14970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783946947.628779:0:14970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.628793:0:14970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946947.628804:0:14970:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff913791b89000 from 1 10000000:01000000:0.0:1783946947.628807:0:14970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783946947.628858:0:14970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.628867:0:14970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.628878:0:14970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946947.628907:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783946947.629047:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946947.629132:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786412f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783946947.632014:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523028608 00000100:00100000:3.0:1783946947.632035:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523028608 00000100:00100000:3.0:1783946947.632146:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783946947.632158:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+10:14970:x1870603523028608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783946947.632176:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946947.632200:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8395 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.632228:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8395 expref: 11 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.632240:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8395 expref: 11 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.632249:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030200, rc 0) 00000100:00100000:3.0:1783946947.632348:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:14970:x1870603523028608:12345-0@lo:101:mount.lustre.0 Request processed in 193us (3300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946947.632356:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783946947.637226:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028608:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783946947.637260:0:14970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.637274:0:14970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946947.637397:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783946947.637461:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946947.637515:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783946947.637660:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523028736 00000100:00100000:0.0:1783946947.637667:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523028736 00000100:00100000:0.0:1783946947.637722:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783946947.637732:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:14970:x1870603523028736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783946947.637895:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:14970:x1870603523028736:12345-0@lo:501:mount.lustre.0 Request processed in 163us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946947.637903:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783946947.638811:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783946947.638863:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783946947.638924:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946947.638965:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783946947.639018:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523028864 00000100:00100000:0.0:1783946947.639023:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523028864 00000100:00100000:0.0:1783946947.639099:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783946947.639109:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:14970:x1870603523028864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783946947.639207:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:14970:x1870603523028864:12345-0@lo:503:mount.lustre.0 Request processed in 98us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946947.639214:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783946947.639304:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523028864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783946947.639864:0:15017:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15017:1870603523028992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946947.639904:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946947.639938:0:15017:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f480 going to sleep for 11 seconds 00000100:00100000:0.0:1783946947.639988:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523028992 00000100:00100000:0.0:1783946947.639994:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523028992 00000100:00100000:0.0:1783946947.640031:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783946947.640039:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:15017:x1870603523028992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783946947.640656:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:15017:x1870603523028992:12345-0@lo:502:llog_process_th.0 Request processed in 615us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946947.640665:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783946947.640762:0:15017:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15017:1870603523028992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783946947.640790:0:15017:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783946947.640799:0:15017:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946947.640801:0:15017:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783946947.640809:0:15017:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff913791b89000 00000020:00000080:1.0:1783946947.640811:0:15017:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783946947.640819:0:15017:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946947.640822:0:15017:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946947.640823:0:15017:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783946947.640826:0:15017:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783946947.640828:0:15017:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946947.640829:0:15017:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783946947.640833:0:15017:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff913791b89000 00000020:00000080:1.0:1783946947.640835:0:15017:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783946947.640911:0:15017:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946947.640916:0:15017:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946947.640917:0:15017:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783946947.640920:0:15017:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783946947.640923:0:15017:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946947.640924:0:15017:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783946947.640928:0:15017:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff913791b89000 00000020:00000080:1.0:1783946947.640936:0:15017:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783946947.640978:0:15017:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15017:1870603523029120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783946947.641015:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946947.641042:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523029120 00000100:00100000:1.0:1783946947.641047:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523029120 00000100:00100000:1.0:1783946947.641109:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783946947.641117:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:15017:x1870603523029120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783946947.641191:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:15017:x1870603523029120:12345-0@lo:502:llog_process_th.0 Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946947.641198:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783946947.641235:0:15017:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946947.641246:0:15017:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15017:1870603523029120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783946947.641264:0:15017:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946947.641268:0:15017:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946947.641270:0:15017:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783946947.641273:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783946947.642518:0:14970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783946947.642719:0:14970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783946947.642745:0:14970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.642757:0:14970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783946947.642812:0:14970:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783946947.642817:0:14970:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff913791b89000 10000000:01000000:1.0:1783946947.642820:0:14970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff913791b89000 10000000:01000000:1.0:1783946947.642824:0:14970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783946947.642845:0:14970:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff913791b89000 from 1 10000000:01000000:1.0:1783946947.642847:0:14970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783946947.642880:0:14970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f44200/0x229d2ec450db83a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.642888:0:14970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137b9f44200/0x229d2ec450db83a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.642898:0:14970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137b9f44200/0x229d2ec450db83a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946947.642921:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523029248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783946947.642972:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946947.643006:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd480 going to sleep for 11 seconds 00000100:00100000:1.0:1783946947.643024:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523029248 00000100:00100000:1.0:1783946947.643030:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523029248 00000100:00100000:1.0:1783946947.643090:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783946947.643100:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:14970:x1870603523029248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783946947.643112:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946947.643128:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44600/0x229d2ec450db83aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db83a3 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.643149:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44600/0x229d2ec450db83aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db83a3 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.643159:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44600/0x229d2ec450db83aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db83a3 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.643168:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44600, rc 0) 00000100:00100000:1.0:1783946947.643205:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14970:x1870603523029248:12345-0@lo:101:mount.lustre.0 Request processed in 106us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946947.643218:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783946947.643262:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523029248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783946947.643275:0:14970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137b9f44200/0x229d2ec450db83a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db83aa expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.643284:0:14970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137b9f44200/0x229d2ec450db83a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db83aa expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946947.644451:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523029376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783946947.644503:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946947.646688:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd480 going to sleep for 11 seconds 00000100:00100000:2.0:1783946947.653991:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523029376 00000100:00100000:2.0:1783946947.654007:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523029376 00000100:00100000:2.0:1783946947.654088:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783946947.654099:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14970:x1870603523029376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783946947.654275:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14970:x1870603523029376:12345-0@lo:501:mount.lustre.0 Request processed in 178us (9771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946947.654283:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783946947.655859:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523029376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783946947.669752:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523029504:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783946947.669839:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946947.669887:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cd480 going to sleep for 11 seconds 00000100:00100000:1.0:1783946947.670566:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523029504 00000100:00100000:1.0:1783946947.670575:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523029504 00000100:00100000:1.0:1783946947.670630:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783946947.670640:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14970:x1870603523029504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783946947.670777:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14970:x1870603523029504:12345-0@lo:503:mount.lustre.0 Request processed in 137us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946947.670785:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783946947.670845:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523029504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783946947.677779:0:15021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15021:1870603523029632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946947.677882:0:15021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946947.677933:0:15021:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783946947.678010:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523029632 00000100:00100000:2.0:1783946947.678017:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523029632 00000100:00100000:2.0:1783946947.679218:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783946947.679237:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:15021:x1870603523029632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783946947.679794:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:15021:x1870603523029632:12345-0@lo:502:llog_process_th.0 Request processed in 561us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946947.679803:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783946947.680300:0:15021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15021:1870603523029632:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783946947.680390:0:15021:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783946947.680407:0:15021:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9137927619c0) 00000020:00000080:3.0:1783946947.680428:0:15021:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1783946947.680826:0:15021:0:(tgt_mount.c:153:server_get_mount()) get mount ffff913791b89000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783946947.680831:0:15021:0:(tgt_mount.c:187:server_put_mount()) put mount ffff913791b89000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783946947.680834:0:15021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff913791b89000 4 00010000:00080000:3.0:1783946947.680862:0:15021:0:(ldlm_lib.c:102:import_set_conn()) imp ffff913792793000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:3.0:1783946947.690919:0:15021:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1783946947.691030:0:15021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783946947.691109:0:15021:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783946947.691124:0:15021:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x229d2ec450db83b8 00000100:00080000:3.0:1783946947.691135:0:15021:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783946947.691140:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff913792793000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1783946947.691176:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be8b1500 x1870603523029760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783946947.691207:0:15021:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783946947.694424:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603523029760:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783946947.694515:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946947.695711:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523029760 00000100:00100000:0.0:1783946947.695723:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523029760 00000100:00100000:0.0:1783946947.695772:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946947.695780:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3446:x1870603523029760:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783946947.695896:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3446:x1870603523029760:12345-0@lo:38:llog_process_th.0 Request processed in 115us (1380us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783946947.695904:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946947.696702:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783946947.696718:0:3446:0:(import.c:65:import_set_state_nolock()) ffff913792793000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783946947.696724:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783946947.696728:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603523029760:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783946947.699506:0:15021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15021:1870603523029888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946947.699800:0:15021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946947.699852:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523029888 00000100:00100000:3.0:1783946947.699860:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523029888 00000100:00100000:3.0:1783946947.699910:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783946947.699919:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be803050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:15021:x1870603523029888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783946947.700043:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be803050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:15021:x1870603523029888:12345-0@lo:502:llog_process_th.0 Request processed in 124us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946947.700050:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783946947.700136:0:15021:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783946947.702493:0:15021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39c72ff9-53ed-483b-b87f-ab321f5fef71:15021:1870603523029888:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783946947.705673:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783946947.706258:0:14970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783946947.706295:0:14970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783946947.706369:0:14970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137b9f44200/0x229d2ec450db83a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db83aa expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946947.706383:0:14970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137b9f44200/0x229d2ec450db83a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db83aa expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783946947.706437:0:14970:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783946947.706440:0:14970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783946947.706441:0:14970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783946947.706442:0:14970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783946947.706443:0:14970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783946947.706445:0:14970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783946947.706446:0:14970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783946947.706447:0:14970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783946947.706449:0:14970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783946947.706450:0:14970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783946947.706454:0:14970:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783946947.706456:0:14970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783946947.706457:0:14970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783946947.706458:0:14970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783946947.706460:0:14970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783946947.706460:0:14970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783946947.706461:0:14970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783946947.706462:0:14970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783946947.706463:0:14970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783946947.706464:0:14970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783946947.706465:0:14970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783946947.706490:0:14970:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783946947.706511:0:14970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523030016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783946947.707457:0:14970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946947.707495:0:14970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137990cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946947.708774:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523030016 00000100:00100000:2.0:1783946947.708786:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523030016 00000100:00100000:2.0:1783946947.708851:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783946947.708861:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14970:x1870603523030016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783946947.708896:0:14986:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783946947.708910:0:14986:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783946947.717028:0:14986:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783946947.717088:0:14986:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783946947.718784:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14970:x1870603523030016:12345-0@lo:253:mount.lustre.0 Request processed in 9917us (11322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946947.718800:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783946947.718909:0:14970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:14970:1870603523030016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783946947.718924:0:14970:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783946947.718927:0:14970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783946947.718938:0:14970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783946947.718939:0:14970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783946947.718940:0:14970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783946947.718941:0:14970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783946947.718942:0:14970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783946947.718943:0:14970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783946947.718944:0:14970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783946947.718946:0:14970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783946947.718947:0:14970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783946947.718964:0:14970:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1783946947.719184:0:15007:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783946947.719189:0:15007:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783946947.719209:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.719223:0:15007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8387 expref: 11 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.719231:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.719264:0:15007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db8387 expref: 11 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.719278:0:15007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db8387 expref: 11 pid: 14984 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946947.719290:0:15007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15007:1870603523030144:0@lo:104: 00000100:00100000:0.0:1783946947.719513:0:15007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946947.719571:0:15007:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be84e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783946947.719610:0:14974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523030144 00000100:00100000:0.0:1783946947.719616:0:14974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523030144 00000100:00100000:0.0:1783946947.719663:0:14974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946947.719672:0:14974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:15007:x1870603523030144:12345-0@lo:104: 00010000:00010000:0.0:1783946947.719685:0:14974:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946947.720281:0:14974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783946947.720289:0:14974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:15007:x1870603523030144:12345-0@lo:104: Request processed in 618us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946947.720297:0:14974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946947.720479:0:15007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15007:1870603523030144:0@lo:104: 00010000:00010000:0.0:1783946947.720496:0:15007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.731736:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946947.731752:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.731764:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780030000 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946947.731768:0:14980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.731778:0:14980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946947.731786:0:14980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946947.731792:0:14980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783946947.731855:0:14980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.731862:0:14980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783946947.731884:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.731906:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff913780030000/0x229d2ec450db8387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db838e expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.731930:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946947.731932:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946947.731934:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946947.731984:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523030272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783946947.732049:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946947.735361:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523030272 00000100:00100000:3.0:1783946947.735381:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523030272 00010000:00010000:3.0:1783946947.735429:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db8387 expref: 12 pid: 14984 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946947.735487:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783946947.735497:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:3448:x1870603523030272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783946947.735512:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783946947.735517:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db8387 expref: 12 pid: 14984 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735544:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db8387 expref: 12 pid: 14984 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735563:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db838e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db8387 expref: 12 pid: 14984 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735580:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735598:0:14976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783946947.735615:0:14976:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016426569s 00010000:00010000:3.0:1783946947.735620:0:14976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735626:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735632:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735638:0:14976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735644:0:14976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8a00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946947.735648:0:14976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735657:0:14976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735674:0:14976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735686:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783946947.735773:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:3448:x1870603523030272:12345-0@lo:103:ldlm_bl.0 Request processed in 278us (3724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946947.735781:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783946947.735823:0:15007:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735831:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946947.735836:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137be3a8a00/0x229d2ec450db83bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946947.736023:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523030272:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783946947.775236:0:14970:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1783946947.775871:0:14970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1783946947.776291:0:15029:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000020:00080000:0.0:1783946947.776838:0:15028:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1783946947.776844:0:15028:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1783946947.776946:0:15029:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783946947.778018:0:14970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783946947.778429:0:14970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783946947.779988:0:14970:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783946947.780009:0:14970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783946947.780132:0:14970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783946947.784051:0:14970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783946947.784613:0:14970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783946947.784649:0:14970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783946947.786089:0:15029:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783946947.786161:0:15029:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783946947.786165:0:15029:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1783946947.792970:0:14970:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1783946947.810607:0:14970:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1783946947.819298:0:14970:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783946947.819399:0:14970:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5c981643988 00100000:10000000:0.0:1783946947.819407:0:14970:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783946947.822041:0:14970:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783946947.822101:0:14970:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783946947.822126:0:14970:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783946947.822148:0:14970:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1783946947.831393:0:14970:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946947.831657:0:14970:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783946948.240423:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783946948.626626:0:14988:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783946948.626633:0:14988:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff913791b89000 from 6 10000000:01000000:2.0:1783946948.626638:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783946948.626705:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946948.626725:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946948.626737:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946948.626765:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523030400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783946948.626838:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946948.626890:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc67c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783946948.628485:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523030400 00000100:00100000:1.0:1783946948.628500:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523030400 00000100:00100000:1.0:1783946948.628578:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783946948.628590:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:14988:x1870603523030400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783946948.628607:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946948.628630:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db83c6 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946948.628660:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db83c6 expref: 12 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946948.628673:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db83c6 expref: 12 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946948.628682:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f44800, rc 0) 00000100:00100000:1.0:1783946948.628763:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14988:x1870603523030400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946948.628770:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783946948.629137:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523030400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783946948.629158:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946948.629169:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946948.629249:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523030528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783946948.629292:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946948.629331:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4a000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946948.629487:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523030528 00000100:00100000:2.0:1783946948.629494:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523030528 00000100:00100000:2.0:1783946948.629552:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783946948.629560:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be802050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14988:x1870603523030528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783946948.629576:0:14985:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783946948.629590:0:14985:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783946948.629594:0:14985:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1783946948.629678:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be802050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14988:x1870603523030528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946948.629685:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783946948.629744:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523030528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783946948.629786:0:14988:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783946948.629793:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946948.629802:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783946948.819963:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783946949.270413:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783946949.846312:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783946950.297674:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946951.312347:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783946952.220956:0:15273:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783946952.336289:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783946953.106767:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783946953.106775:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783946953.106777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783946953.106781:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783946953.106784:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783946953.106787:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783946953.106806:0:36:0:(import.c:65:import_set_state_nolock()) ffff913792793000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783946953.106818:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff913792793000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946953.106844:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be944000 x1870603523030784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783946953.106900:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783946953.106913:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39c72ff9-53ed-483b-b87f-ab321f5fef71:3450:1870603523030656:0@lo:400:kworker.0 00000100:00100000:0.0:1783946953.106989:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946953.107053:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523030656 00000100:00100000:0.0:1783946953.107075:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523030656 00000100:00100000:0.0:1783946953.107121:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783946953.107131:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be803c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:3450:x1870603523030656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946953.107180:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be803c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:3450:x1870603523030656:12345-0@lo:400:kworker.0 Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946953.107188:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783946953.107252:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39c72ff9-53ed-483b-b87f-ab321f5fef71:3450:1870603523030656:0@lo:400:kworker.0 00000100:00100000:2.0:1783946953.108742:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603523030784:0@lo:38:kworker.0 00000100:00100000:2.0:1783946953.108796:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946953.108921:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523030784 00000100:00100000:3.0:1783946953.108928:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523030784 00000100:00100000:3.0:1783946953.108995:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783946953.109003:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3446:x1870603523030784:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783946953.109030:0:14993:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1783946953.109097:0:14993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x229d2ec450db83d4 00000004:00100000:3.0:1783946953.109114:0:14993:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783946953.109238:0:14993:0:(import.c:65:import_set_state_nolock()) ffff91378617e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783946953.109287:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1870603523030784:12345-0@lo:38:kworker.0 Request processed in 283us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946953.109295:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783946953.110048:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9137be944000 x1870603523030784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783946963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783946953.110101:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783946953.110109:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783946953.110114:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783946953.110117:0:3446:0:(import.c:65:import_set_state_nolock()) ffff913792793000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783946953.110129:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3446:1870603523030784:0@lo:38:kworker.0 00000020:00000004:3.0:1783946953.135836:0:15325:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946953.136026:0:15325:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783946953.361612:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783946953.900741:0:15375:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783946953.900930:0:15375:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783946954.386767:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783946955.245326:0:15423:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff28fbd3b0 20000000:00000080:0.0:1783946955.245352:0:15423:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9137c15f7000 uarg=0000000000000000 20000000:01000000:0.0:1783946955.246112:0:15423:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783946955.246124:0:15423:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783946955.246131:0:15423:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783946955.251315:0:15424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1783946955.253284:0:15423:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783946955.265676:0:15423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783946955.265801:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946955.265832:0:15423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8395 expref: 11 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946955.265843:0:15423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946955.265927:0:15423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db8395 expref: 11 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946955.265948:0:15423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db8395 expref: 11 pid: 14984 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946955.265982:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15423:1870603523030912:0@lo:104: 00000100:00100000:0.0:1783946955.266166:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946955.266349:0:14974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523030912 00000100:00100000:1.0:1783946955.266361:0:14974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523030912 00000100:00100000:1.0:1783946955.266441:0:14974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783946955.266452:0:14974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:15423:x1870603523030912:12345-0@lo:104: 00010000:00010000:1.0:1783946955.266475:0:14974:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946955.266586:0:14974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783946955.266595:0:14974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:15423:x1870603523030912:12345-0@lo:104: Request processed in 144us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946955.266603:0:14974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783946955.266622:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946955.266634:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946955.266645:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9c00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783946955.266652:0:14980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946955.266665:0:14980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783946955.266673:0:14980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946955.266680:0:14980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783946955.266748:0:14980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946955.266756:0:14980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783946955.266789:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946955.266796:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8395 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db839c expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946955.266817:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946955.266819:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946955.266820:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946955.266840:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39c72ff9-53ed-483b-b87f-ab321f5fef71:3450:1870603523031040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783946955.266888:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946955.267731:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be623180 going to sleep for 11 seconds 00000100:00100000:0.0:1783946955.267767:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15423:1870603523030912:0@lo:104: 00010000:00010000:0.0:1783946955.267793:0:15423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946955.275248:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523031040 00000100:00100000:2.0:1783946955.275275:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523031040 00010000:00010000:2.0:1783946955.275345:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db8395 expref: 12 pid: 14984 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946955.275440:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946955.275454:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:3450:x1870603523031040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783946955.275475:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783946955.275482:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db8395 expref: 12 pid: 14984 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275759:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db8395 expref: 12 pid: 14984 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275784:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913780030200/0x229d2ec450db839c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db8395 expref: 12 pid: 14984 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275809:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275818:0:14976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275841:0:14976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275849:0:14976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275857:0:14976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275882:0:14976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275890:0:14976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946955.275895:0:14976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.275904:0:14976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946955.285854:0:15423:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946955.285881:0:15423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.289214:0:14976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.289247:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137be3a9600/0x229d2ec450db83db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946955.289280:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783946955.289487:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:3450:x1870603523031040:12345-0@lo:103:ldlm_bl.0 Request processed in 14030us (22592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946955.289503:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783946955.289678:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39c72ff9-53ed-483b-b87f-ab321f5fef71:3450:1870603523031040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783946955.408526:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946956.432596:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783946957.140147:0:14988:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783946957.140156:0:14988:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff913791b89000 from 10 10000000:01000000:0.0:1783946957.140162:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783946957.140215:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946957.140240:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946957.140252:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946957.140309:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523031168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783946957.140399:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946957.140456:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783946957.140567:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523031168 00000100:00100000:1.0:1783946957.140576:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523031168 00000100:00100000:1.0:1783946957.140637:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783946957.140648:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+11:14988:x1870603523031168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783946957.140661:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946957.140675:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db83e2 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946957.140699:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db83e2 expref: 12 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946957.140711:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db83e2 expref: 12 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946957.140733:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45400, rc 0) 00000100:00100000:1.0:1783946957.140779:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14988:x1870603523031168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946957.140786:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783946957.140834:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523031168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783946957.140851:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946957.140860:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946957.140922:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523031296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783946957.140949:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946957.140963:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786412540 going to sleep for 11 seconds 00000100:00100000:1.0:1783946957.140976:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523031296 00000100:00100000:1.0:1783946957.140979:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523031296 00000100:00100000:1.0:1783946957.141002:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783946957.141009:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14988:x1870603523031296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783946957.141151:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14988:x1870603523031296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946957.141158:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783946957.141188:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523031296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783946957.141215:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523031424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783946957.141253:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946957.141273:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff913786412540 going to sleep for 11 seconds 00000100:00100000:1.0:1783946957.141284:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523031424 00000100:00100000:1.0:1783946957.141287:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523031424 00000100:00100000:1.0:1783946957.141321:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783946957.141327:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14988:x1870603523031424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783946957.141411:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:14988:x1870603523031424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946957.141417:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783946957.141458:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523031424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783946957.149249:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783946957.152184:0:14988:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783946957.152374:0:14988:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783946957.152388:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946957.152402:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946957.200652:0:3446:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783946947/real 1783946947] req@ffff9137be946a00 x1870603523028096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783946957 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946957.200714:0:3446:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9137be946a00 x1870603523028096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783946957 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946957.200739:0:3446:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783946947/real 1783946947] req@ffff9137be947800 x1870603523027968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783946957 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946957.200762:0:3446:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9137be947800 x1870603523027968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783946957 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783946957.200815:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783946957.200879:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783946957.200884:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523028096:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783946957.200890:0:3446:0:(import.c:65:import_set_state_nolock()) ffff913784354000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783946957.200952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783946957.200957:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783946957.200960:0:36:0:(import.c:65:import_set_state_nolock()) ffff913784354000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783946957.200982:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 551 00000100:00080000:1.0:1783946957.200988:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783946957.201008:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff913784354000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946957.201117:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be93ed80 x1870603523031552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783946957.201144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783946957.201155:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783946957.201156:0:36:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783946957.201160:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 551 00000100:00080000:1.0:1783946957.201162:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783946957.201166:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9137b9cdd800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946957.201180:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be93d180 x1870603523031680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783946957.201456:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523031808:0@lo:400:kworker.0 00000100:00100000:3.0:1783946957.201561:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783946957.201757:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783946957.201762:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523027968:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783946957.201797:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523031552:0@lo:8:kworker.0 00000400:00000100:2.0:1783946957.201845:0:3446:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870603523031552 offset 0 length 520: 4 00000100:00100000:2.0:1783946957.201863:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523031680:0@lo:8:kworker.0 00000400:00000100:2.0:1783946957.201900:0:3446:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870603523031680 offset 0 length 520: 4 00000100:00100000:3.0:1783946957.208611:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523031808 00000100:00100000:3.0:1783946957.208624:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523031808 00000100:00100000:3.0:1783946957.208707:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783946957.208718:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523031808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946957.208810:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523031808:12345-0@lo:400:kworker.0 Request processed in 94us (7250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946957.208817:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783946957.208861:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9137be93c700 x1870603523031808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946957.208891:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523031808:0@lo:400:kworker.0 00010000:00010000:1.0:1783946957.456239:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946958.481401:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783946959.073853:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783946959.508225:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946960.528214:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946961.552417:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783946962.323102:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783946962.323109:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783946962.323111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783946962.323114:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783946962.323154:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523032064:0@lo:400:kworker.0 00000100:00100000:2.0:1783946962.323224:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946962.323282:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523031936:0@lo:400:kworker.0 00000100:00100000:3.0:1783946962.323319:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946962.323367:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523032064 00000100:00100000:3.0:1783946962.323376:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523032064 00000100:00100000:3.0:1783946962.323421:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783946962.323430:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523032064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946962.323482:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523031936 00000100:00100000:2.0:1783946962.323486:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523031936 00000100:00100000:3.0:1783946962.323507:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523032064:12345-0@lo:400:kworker.0 Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946962.323515:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946962.323515:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783946962.323521:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:3448:x1870603523031936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946962.323566:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:3448:x1870603523031936:12345-0@lo:400:kworker.0 Request processed in 44us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946962.323584:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783946962.323672:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9137be844380 x1870603523032064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946962.323686:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523032064:0@lo:400:kworker.0 00000100:00100000:3.0:1783946962.323736:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523031936:0@lo:400:kworker.0 00010000:00010000:1.0:1783946962.576456:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946963.601143:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946964.625818:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783946965.185003:0:15770:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783946965.185008:0:15770:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783946965.185009:0:15770:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783946965.186447:0:15770:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9137b6557000 00000020:01000004:2.0:1783946965.186465:0:15770:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783946965.186477:0:15770:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783946965.186492:0:15770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9137ba31cd40) 00000020:00000080:2.0:1783946965.186509:0:15770:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783946965.275169:0:15770:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783946965.275736:0:15770:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1783946965.275959:0:15770:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783946965.276518:0:15770:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783946965.276725:0:15770:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783946965.276936:0:15770:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1783946965.277184:0:15770:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1783946965.280495:0:15770:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783946965.280719:0:15770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783946965.280730:0:15770:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783946965.280742:0:15770:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x229d2ec450db83f7 00000020:01000004:0.0:1783946965.280749:0:15770:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783946965.280770:0:15770:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783946965.280774:0:15770:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783946965.280779:0:15770:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783946965.280784:0:15770:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783946965.280794:0:15770:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9137b65e0000) 00000020:00000080:0.0:1783946965.280803:0:15770:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1783946965.282805:0:15770:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946965.282957:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783946965.282963:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783946965.283886:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783946965.283895:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783946965.284420:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783946965.284427:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783946965.288860:0:15770:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783946965.289016:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783946965.289023:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783946965.289837:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783946965.289845:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783946965.331795:0:15770:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783946965.332027:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783946965.332034:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783946965.334745:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783946965.334759:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783946965.335711:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783946965.335723:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783946965.338838:0:15770:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783946965.339038:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783946965.339045:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783946965.339971:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783946965.339980:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783946965.385323:0:15770:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783946965.385716:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783946965.385723:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783946965.387905:0:15770:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783946965.387918:0:15770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783946965.388781:0:15770:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783946965.388817:0:15770:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783946965.388823:0:15770:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783946965.401001:0:15770:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783946965.401048:0:15770:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783946965.401053:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783946965.401055:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783946965.401056:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946965.401057:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946965.401232:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946965.401234:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946965.401236:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946965.401238:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946965.401239:0:15770:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783946965.401334:0:15770:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783946965.401338:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783946965.401339:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783946965.401340:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946965.401341:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946965.401342:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946965.401343:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946965.401344:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946965.401345:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946965.401346:0:15770:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783946965.401377:0:15770:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783946965.401409:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032192:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783946965.401503:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946965.401711:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523032192 00000100:00100000:0.0:1783946965.401722:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523032192 00000100:00100000:0.0:1783946965.401780:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783946965.401790:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:15770:x1870603523032192:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783946965.401837:0:14985:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783946965.401840:0:14985:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783946965.401844:0:14985:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783946965.401916:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc9f480 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.402788:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:15770:x1870603523032192:12345-0@lo:253:mount.lustre.0 Request processed in 995us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.402798:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783946965.402887:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032192:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783946965.402897:0:15770:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783946965.402899:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783946965.402901:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783946965.402902:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946965.402903:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946965.402904:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946965.402905:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946965.402906:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946965.402907:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946965.402908:0:15770:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783946965.402924:0:15770:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9137b6557000 from lustre-OST0000 10000000:01000000:2.0:1783946965.402952:0:15770:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783946965.402955:0:15770:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783946965.402961:0:15770:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff913792763380 local copy 00010000:00010000:2.0:1783946965.402971:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946965.403053:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783946965.404215:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946965.404267:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137832fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.404537:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523032320 00000100:00100000:1.0:1783946965.404545:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523032320 00000100:00100000:1.0:1783946965.404594:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783946965.404603:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:15770:x1870603523032320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783946965.404727:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:15770:x1870603523032320:12345-0@lo:501:mount.lustre.0 Request processed in 125us (516us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783946965.404734:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783946965.404858:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032320:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783946965.404876:0:15770:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783946965.404900:0:15770:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783946965.404907:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.404916:0:15770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946965.404941:0:15770:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9137b6557000 10000000:01000000:3.0:1783946965.404944:0:15770:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783946965.404949:0:15770:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff913792763380 10000000:01000000:3.0:1783946965.404951:0:15770:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783946965.404954:0:15770:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff913792763380 from 1 10000000:01000000:3.0:1783946965.404956:0:15770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783946965.404982:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030800/0x229d2ec450db8405 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.404989:0:15770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913780030800/0x229d2ec450db8405 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.404998:0:15770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913780030800/0x229d2ec450db8405 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946965.405013:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783946965.405037:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946965.405182:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523032448 00000100:00100000:2.0:1783946965.405186:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523032448 00000100:00100000:2.0:1783946965.405225:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783946965.405232:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+12:15770:x1870603523032448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783946965.405241:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946965.405260:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137bdca9000/0x229d2ec450db840c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8405 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946965.405292:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137bdca9000/0x229d2ec450db840c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8405 expref: 13 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946965.405302:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137bdca9000/0x229d2ec450db840c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8405 expref: 13 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946965.405310:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9000, rc 0) 00000100:00100000:2.0:1783946965.405332:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+13:15770:x1870603523032448:12345-0@lo:101:mount.lustre.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946965.405337:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783946965.405497:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787fcd900 going to sleep for 11 seconds 00000100:00100000:3.0:1783946965.405517:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783946965.405529:0:15770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913780030800/0x229d2ec450db8405 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db840c expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.405537:0:15770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913780030800/0x229d2ec450db8405 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db840c expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946965.405553:0:15770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783946965.405700:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030800/0x229d2ec450db8405 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db840c expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.405707:0:15770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913780030800/0x229d2ec450db8405 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db840c expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946965.405713:0:15770:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783946965.405717:0:15770:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783946965.405721:0:15770:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783946965.405722:0:15770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783946965.405734:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db8413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.405740:0:15770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db8413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.405746:0:15770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db8413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946965.405757:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783946965.405778:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946965.405809:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787fcd900 going to sleep for 11 seconds 00000100:00100000:2.0:1783946965.406110:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523032576 00000100:00100000:2.0:1783946965.406115:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523032576 00000100:00100000:2.0:1783946965.406134:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783946965.406139:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be431c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+13:15770:x1870603523032576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783946965.406146:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946965.406153:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137bdca8c00/0x229d2ec450db841a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8413 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946965.406165:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137bdca8c00/0x229d2ec450db841a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8413 expref: 14 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946965.406172:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137bdca8c00/0x229d2ec450db841a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8413 expref: 14 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946965.406177:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8c00, rc 0) 00000100:00100000:2.0:1783946965.406209:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be431c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523032576:12345-0@lo:101:mount.lustre.0 Request processed in 69us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946965.406213:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783946965.406360:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783946965.406370:0:15770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db8413 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db841a expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.406377:0:15770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db8413 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db841a expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783946965.407591:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783946965.408213:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783946965.411422:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783946965.411479:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783946965.411491:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783946965.411502:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783946965.411521:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783946965.411534:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783946965.411557:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783946965.411562:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783946965.411731:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783946965.411803:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946965.411895:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787fcdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.411937:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523032704 00000100:00100000:1.0:1783946965.411945:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523032704 00000100:00100000:1.0:1783946965.412025:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783946965.412034:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523032704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783946965.412208:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523032704:12345-0@lo:501:mount.lustre.0 Request processed in 174us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.412216:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783946965.412314:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783946965.412343:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783946965.412383:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946965.413000:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787fcdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946965.413028:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523032832 00000100:00100000:2.0:1783946965.413033:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523032832 00000100:00100000:1.0:1783946965.413195:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783946965.413204:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523032832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783946965.413909:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523032832:12345-0@lo:503:mount.lustre.0 Request processed in 705us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.413918:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783946965.414005:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032832:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783946965.414479:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783946965.414561:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783946965.414609:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946965.414991:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787fcd900 going to sleep for 11 seconds 00000100:00100000:0.0:1783946965.415043:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523032960 00000100:00100000:0.0:1783946965.415049:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523032960 00000100:00100000:0.0:1783946965.415105:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783946965.415113:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523032960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946965.415547:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523032960:12345-0@lo:502:mount.lustre.0 Request processed in 434us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946965.415555:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783946965.415660:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523032960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783946965.415843:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783946965.415871:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783946965.415884:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783946965.415896:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783946965.415923:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783946965.415936:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783946965.415947:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783946965.415958:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783946965.415968:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783946965.415979:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783946965.415989:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783946965.416000:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1783946965.416028:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783946965.416098:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946965.416116:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787fcd900 going to sleep for 11 seconds 00000100:00100000:0.0:1783946965.416308:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523033088 00000100:00100000:0.0:1783946965.416314:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523033088 00000100:00100000:0.0:1783946965.416340:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783946965.416347:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523033088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946965.416423:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523033088:12345-0@lo:502:mount.lustre.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946965.416430:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783946965.416567:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783946965.416605:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1783946965.416614:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1783946965.417407:0:15787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783946965.417415:0:15787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783946965.417422:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946965.417424:0:15787:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783946965.417429:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783946965.417443:0:15787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff913792764d40) 00000020:00000080:3.0:1783946965.417464:0:15787:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783946965.417471:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783946965.417553:0:15787:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9137b6557000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783946965.417561:0:15787:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783946965.417568:0:15787:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x229d2ec450db8428 00010000:00010000:3.0:1783946965.422424:0:15787:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1783946965.422880:0:15787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1783946965.424458:0:15787:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1783946965.425971:0:15787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783946965.425984:0:15787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783946965.425991:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946965.425993:0:15787:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783946965.425997:0:15787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783946965.425999:0:15787:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1783946965.426000:0:15787:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783946965.426002:0:15787:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783946965.426003:0:15787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783946965.426005:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946965.426006:0:15787:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783946965.426008:0:15787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783946965.426011:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946965.426012:0:15787:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783946965.426014:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783946965.426016:0:15787:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783946965.426019:0:15787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783946965.426022:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946965.426023:0:15787:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783946965.426026:0:15787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783946965.426028:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946965.426029:0:15787:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783946965.426032:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783946965.426110:0:15787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783946965.426114:0:15787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783946965.426115:0:15787:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783946965.426118:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1783946965.426371:0:15770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783946965.426398:0:15770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783946965.426420:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db8413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db841a expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.426431:0:15770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913780030200/0x229d2ec450db8413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db841a expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946965.426447:0:15770:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137b6557000 from 1 10000000:01000000:0.0:1783946965.426450:0:15770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783946965.426484:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.426491:0:15770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.426503:0:15770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946965.426529:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783946965.426597:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946965.426649:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946965.426944:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523033216 00000100:00100000:3.0:1783946965.426961:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523033216 00000100:00100000:3.0:1783946965.427008:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783946965.427018:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+14:15770:x1870603523033216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783946965.427036:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946965.427050:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db842f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.427109:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db842f expref: 15 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.427120:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db842f expref: 15 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.427128:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913780030400, rc 0) 00000100:00100000:3.0:1783946965.427167:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033216:12345-0@lo:101:mount.lustre.0 Request processed in 150us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946965.427175:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783946965.427435:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783946965.427450:0:15770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.427458:0:15770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783946965.428510:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783946965.428828:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783946965.429018:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783946965.429046:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783946965.429412:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783946965.429420:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1783946965.429487:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783946965.429551:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946965.429590:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc67cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.429776:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523033344 00000100:00100000:1.0:1783946965.429784:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523033344 00000100:00100000:1.0:1783946965.429828:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783946965.429838:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be433850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783946965.429952:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be433850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033344:12345-0@lo:501:mount.lustre.0 Request processed in 115us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.429960:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783946965.430195:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783946965.430235:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783946965.430341:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946965.430358:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc67cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.430414:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523033472 00000100:00100000:1.0:1783946965.430418:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523033472 00000100:00100000:1.0:1783946965.430454:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783946965.430461:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783946965.430544:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033472:12345-0@lo:503:mount.lustre.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.430551:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783946965.430723:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033472:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783946965.431433:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783946965.431498:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946965.431546:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946965.431634:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946965.436123:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523033600 00000100:00100000:3.0:1783946965.436137:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523033600 00000100:00100000:3.0:1783946965.436193:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783946965.436203:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783946965.436374:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033600:12345-0@lo:502:mount.lustre.0 Request processed in 172us (4827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946965.436382:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783946965.436509:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783946965.436837:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783946965.436870:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783946965.436884:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783946965.436897:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783946965.436910:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783946965.436936:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783946965.436950:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783946965.436961:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1783946965.436993:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946965.437036:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946965.437098:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946965.437161:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523033728 00000100:00100000:3.0:1783946965.437166:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523033728 00000100:00100000:3.0:1783946965.437199:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783946965.437206:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783946965.437293:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033728:12345-0@lo:502:mount.lustre.0 Request processed in 87us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946965.437300:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783946965.437704:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783946965.437739:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783946965.437749:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783946965.438409:0:15791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946965.438419:0:15791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946965.438421:0:15791:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783946965.438427:0:15791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9137b6557000 00000020:00000080:0.0:1783946965.438429:0:15791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783946965.438436:0:15791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946965.438438:0:15791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946965.438439:0:15791:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783946965.438441:0:15791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946965.438443:0:15791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946965.438444:0:15791:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783946965.438448:0:15791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9137b6557000 00000020:00000080:0.0:1783946965.438450:0:15791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783946965.438495:0:15791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946965.438498:0:15791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946965.438499:0:15791:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783946965.438502:0:15791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946965.438504:0:15791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946965.438505:0:15791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783946965.438508:0:15791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9137b6557000 00000020:00000080:0.0:1783946965.438510:0:15791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783946965.438529:0:15791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946965.438532:0:15791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946965.438533:0:15791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783946965.438535:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1783946965.438561:0:15770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1783946965.438579:0:15770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783946965.438592:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.438602:0:15770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946965.439367:0:15770:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783946965.439372:0:15770:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9137b6557000 10000000:01000000:0.0:1783946965.439377:0:15770:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9137b6557000 10000000:01000000:0.0:1783946965.439380:0:15770:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783946965.439386:0:15770:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9137b6557000 from 1 10000000:01000000:0.0:1783946965.439390:0:15770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783946965.439421:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a9200/0x229d2ec450db843d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.439431:0:15770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137be3a9200/0x229d2ec450db843d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.439440:0:15770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137be3a9200/0x229d2ec450db843d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946965.439459:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783946965.439511:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946965.439546:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc679c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.440568:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523033856 00000100:00100000:1.0:1783946965.440577:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523033856 00000100:00100000:1.0:1783946965.440620:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783946965.440630:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:15770:x1870603523033856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783946965.440644:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946965.440658:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137b9f45000/0x229d2ec450db8444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db843d expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946965.440681:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137b9f45000/0x229d2ec450db8444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db843d expref: 16 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946965.440693:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137b9f45000/0x229d2ec450db8444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db843d expref: 16 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946965.440702:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137b9f45000, rc 0) 00000100:00100000:1.0:1783946965.440760:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523033856:12345-0@lo:101:mount.lustre.0 Request processed in 131us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.440767:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783946965.441474:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783946965.441492:0:15770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137be3a9200/0x229d2ec450db843d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8444 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.441502:0:15770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137be3a9200/0x229d2ec450db843d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db8444 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783946965.443950:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1783946965.444276:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783946965.444441:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783946965.444464:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783946965.444479:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783946965.444493:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783946965.444505:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783946965.444518:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783946965.444529:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783946965.444541:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783946965.444552:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783946965.444564:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783946965.444575:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783946965.444584:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783946965.444612:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783946965.445170:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783946965.445189:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783946965.445203:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783946965.445215:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783946965.445672:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783946965.445703:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783946965.445716:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783946965.445728:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783946965.445740:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783946965.445752:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783946965.445765:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783946965.445778:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1783946965.445790:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1783946965.445804:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1783946965.445815:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1783946965.445847:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1783946965.445854:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1783946965.445945:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783946965.446016:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946965.447791:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137976c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.480524:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523033984 00000100:00100000:1.0:1783946965.480546:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523033984 00000100:00100000:1.0:1783946965.480617:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783946965.480630:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523033984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783946965.480856:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523033984:12345-0@lo:501:mount.lustre.0 Request processed in 228us (34839us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.480872:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783946965.481832:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523033984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783946965.481909:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523034112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783946965.481984:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946965.482036:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc673c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.499797:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523034112 00000100:00100000:1.0:1783946965.499814:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523034112 00000100:00100000:1.0:1783946965.499901:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783946965.499912:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523034112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783946965.501439:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523034112:12345-0@lo:503:mount.lustre.0 Request processed in 1521us (19446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.501451:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783946965.502195:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523034112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783946965.503541:0:15770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783946965.504756:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523034240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783946965.504851:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946965.505527:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137976c8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.510598:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523034240 00000100:00100000:1.0:1783946965.510612:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523034240 00000100:00100000:0.0:1783946965.510758:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783946965.510769:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523034240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946965.511164:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523034240:12345-0@lo:502:mount.lustre.0 Request processed in 396us (6312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946965.511183:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783946965.511253:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523034240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783946965.511594:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783946965.511630:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783946965.511647:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783946965.511660:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783946965.511675:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783946965.511689:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783946965.511703:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783946965.511717:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783946965.511731:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783946965.511744:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783946965.511776:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783946965.511794:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783946965.511806:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783946965.511817:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783946965.511829:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783946965.511843:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783946965.511855:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783946965.511868:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783946965.511881:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783946965.511892:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783946965.511905:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783946965.511916:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783946965.511929:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783946965.511942:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783946965.511956:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1783946965.511968:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1783946965.511994:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1783946965.512008:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1783946965.512025:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1783946965.512038:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1783946965.512049:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1783946965.512104:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1783946965.512118:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1783946965.512133:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1783946965.512146:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1783946965.512159:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1783946965.512177:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1783946965.512192:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1783946965.512206:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1783946965.512231:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1783946965.512271:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be847800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523034368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783946965.512326:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946965.512366:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946965.512684:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523034368 00000100:00100000:1.0:1783946965.512690:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523034368 00000100:00100000:1.0:1783946965.512728:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783946965.512735:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523034368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783946965.512825:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523034368:12345-0@lo:502:mount.lustre.0 Request processed in 89us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.512832:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783946965.512854:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be847800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523034368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783946965.512895:0:15770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1783946965.512903:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1783946965.513751:0:15796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783946965.513764:0:15796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9137b65e4d40) 00000020:00000080:0.0:1783946965.513784:0:15796:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1783946965.513928:0:15796:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9137b6557000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783946965.513932:0:15796:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9137b6557000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783946965.513934:0:15796:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9137b6557000 3 00010000:00080000:0.0:1783946965.513969:0:15796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9137b9db8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1783946965.520841:0:15796:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1783946965.520932:0:15796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783946965.520970:0:15796:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783946965.520982:0:15796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x229d2ec450db8452 00000100:00080000:1.0:1783946965.520991:0:15796:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783946965.520995:0:15796:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9137b9db8000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946965.521027:0:15796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be93d880 x1870603523034496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783946965.521086:0:15796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783946965.523035:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3446:1870603523034496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783946965.523134:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783946965.523198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783946965.523202:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783946965.523205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783946965.523209:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783946965.523331:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523034624:0@lo:400:kworker.0 00000100:00100000:0.0:1783946965.523359:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783946965.523386:0:15796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1783946965.523405:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523034496 00000100:00100000:0.0:1783946965.523411:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523034496 00000100:00100000:0.0:1783946965.523436:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523034624 00000100:00100000:0.0:1783946965.523439:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523034624 00000020:01000000:2.0:1783946965.523442:0:15770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:0.0:1783946965.523463:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946965.523471:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523034624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946965.523527:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523034624:12345-0@lo:400:kworker.0 Request processed in 56us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946965.523535:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946965.523551:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946965.523555:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3446:x1870603523034496:12345-0@lo:38:llog_process_th.0 10000000:01000000:2.0:1783946965.523564:0:15770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:0.0:1783946965.523576:0:14993:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 569 last 0 00010000:00010000:2.0:1783946965.523578:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a9200/0x229d2ec450db843d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8444 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946965.523599:0:15770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137be3a9200/0x229d2ec450db843d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8444 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783946965.523643:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783946965.523644:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783946965.523646:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946965.523647:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946965.523648:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946965.523649:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946965.523651:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946965.523653:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946965.523654:0:15770:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783946965.523658:0:15770:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783946965.523660:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783946965.523662:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783946965.523663:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946965.523664:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946965.523665:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946965.523666:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946965.523667:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946965.523668:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946965.523669:0:15770:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783946965.523683:0:15770:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783946965.523696:0:15770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523034752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783946965.523729:0:15770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946965.523753:0:15770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bde77a80 going to sleep for 11 seconds 00010000:00080000:2.0:1783946965.524182:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9137be846300 x1870603523034624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946965.524195:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523034624:0@lo:400:kworker.0 00000100:00100000:1.0:1783946965.524585:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523034752 00000100:00100000:1.0:1783946965.524590:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523034752 00000100:00100000:1.0:1783946965.524634:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783946965.524653:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523034752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783946965.524677:0:14985:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783946965.524687:0:14985:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000080:0.0:1783946965.525012:0:14993:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x229d2ec450db8459 00000004:00100000:0.0:1783946965.525032:0:14993:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783946965.525356:0:14993:0:(import.c:65:import_set_state_nolock()) ffff9137b9dba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783946965.525428:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1870603523034496:12345-0@lo:38:llog_process_th.0 Request processed in 1870us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946965.525441:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783946965.525751:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9137be93d880 x1870603523034496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783946975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946965.525761:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783946965.525768:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1783946965.525775:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783946965.525779:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783946965.525782:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b9db8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783946965.525787:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3446:1870603523034496:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1783946965.533841:0:14985:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783946965.533888:0:14985:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783946965.533982:0:15007:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783946965.533989:0:15007:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783946965.534019:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.534044:0:15007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db83c6 expref: 16 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.534055:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783946965.534306:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:15770:x1870603523034752:12345-0@lo:253:mount.lustre.0 Request processed in 9655us (10572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946965.534319:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783946965.534352:0:15770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be847100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:15770:1870603523034752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783946965.534378:0:15770:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783946965.534381:0:15770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783946965.534383:0:15770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783946965.534384:0:15770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946965.534385:0:15770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946965.534387:0:15770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946965.534387:0:15770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946965.534389:0:15770:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946965.534391:0:15770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946965.534392:0:15770:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783946965.534413:0:15770:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783946965.534458:0:15007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db83c6 expref: 15 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.534473:0:15007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db83c6 expref: 15 pid: 14984 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946965.534487:0:15007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15007:1870603523034880:0@lo:104: 00000100:00100000:3.0:1783946965.534526:0:15007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946965.534598:0:15007:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137976c8840 going to sleep for 11 seconds 00000100:00100000:0.0:1783946965.534662:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523034880 00000100:00100000:0.0:1783946965.534670:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523034880 00000100:00100000:0.0:1783946965.534745:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946965.534757:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:15007:x1870603523034880:12345-0@lo:104: 00010000:00010000:0.0:1783946965.534771:0:14975:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.534830:0:14975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783946965.534836:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:15007:x1870603523034880:12345-0@lo:104: Request processed in 82us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946965.534842:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783946965.534896:0:15007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15007:1870603523034880:0@lo:104: 00010000:00010000:3.0:1783946965.534910:0:15007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.534974:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783946965.534980:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.534988:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8400 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:0.0:1783946965.534993:0:14979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535003:0:14979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783946965.535012:0:14979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946965.535019:0:14979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783946965.535243:0:14979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535263:0:14979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783946965.535317:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523035008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783946965.535348:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783946965.535395:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535404:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137bdca8400/0x229d2ec450db83c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db83cd expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535420:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946965.535422:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946965.535424:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783946965.535458:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523035008 00000100:00100000:0.0:1783946965.535462:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523035008 00010000:00010000:0.0:1783946965.535481:0:14977:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db83c6 expref: 16 pid: 14984 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946965.535505:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946965.535513:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:3447:x1870603523035008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783946965.535523:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946965.535528:0:14977:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db83c6 expref: 16 pid: 14984 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535539:0:14977:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db83c6 expref: 16 pid: 14984 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535552:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f44800/0x229d2ec450db83cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db83c6 expref: 16 pid: 14984 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535567:0:14977:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535586:0:14977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783946965.535600:0:14977:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016426569s 00010000:00010000:0.0:1783946965.535605:0:14977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535612:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535619:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535626:0:14977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535633:0:14977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913780031200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946965.535637:0:14977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535645:0:14977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535659:0:14977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946965.535667:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946965.535747:0:15007:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.535755:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946965.535762:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913780031200/0x229d2ec450db8460 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946965.535822:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:3447:x1870603523035008:12345-0@lo:103:ldlm_bl.0 Request processed in 310us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946965.535830:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783946965.535885:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523035008:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1783946965.540904:0:15770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1783946965.543483:0:15770:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783946965.543494:0:15770:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783946965.543535:0:15770:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783946965.543582:0:15770:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783946965.543606:0:15770:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783946965.543629:0:15770:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783946965.544616:0:15770:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783946965.544830:0:15770:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783946965.651771:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783946966.404573:0:15849:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783946966.404700:0:15849:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783946966.674002:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783946966.865179:0:14988:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783946966.865187:0:14988:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff913791b89000 from 7 10000000:01000000:2.0:1783946966.865191:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783946966.865267:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946966.865280:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946966.865292:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946966.865321:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be847100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523035136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783946966.865406:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946966.865457:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787fcda80 going to sleep for 11 seconds 00000100:00100000:2.0:1783946966.865478:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523035136 00000100:00100000:2.0:1783946966.865486:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523035136 00000100:00100000:2.0:1783946966.865538:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783946966.865547:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+15:14988:x1870603523035136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946966.865561:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946966.865575:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8467 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946966.865599:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8467 expref: 16 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946966.865609:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8467 expref: 16 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946966.865619:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8e00, rc 0) 00000100:00100000:2.0:1783946966.865654:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:14988:x1870603523035136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946966.865662:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783946966.865708:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be847100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523035136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783946966.865723:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946966.865733:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946966.865777:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be847100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523035264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783946966.865811:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946966.865827:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783946966.866099:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523035264 00000100:00100000:1.0:1783946966.866104:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523035264 00000100:00100000:1.0:1783946966.866285:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783946966.866295:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:14988:x1870603523035264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783946966.866311:0:14985:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783946966.866326:0:14985:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783946966.866329:0:14985:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1783946966.866548:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:14988:x1870603523035264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 254us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946966.866556:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783946966.866659:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be847100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523035264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783946966.866714:0:14988:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783946966.866722:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946966.866731:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946967.707959:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946968.721317:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783946969.296988:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783946969.752199:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946970.768333:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783946971.024205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783946971.024213:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783946971.024215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783946971.024228:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783946971.024282:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523035520:0@lo:400:kworker.0 00000100:00100000:2.0:1783946971.024351:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946971.024408:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946971.024414:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523035648:0@lo:400:kworker.0 00000100:00100000:2.0:1783946971.024437:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946971.024486:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523035520 00000100:00100000:2.0:1783946971.024494:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523035520 00000100:00100000:2.0:1783946971.024536:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523035648 00000100:00100000:2.0:1783946971.024539:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523035648 00000100:00100000:2.0:1783946971.024583:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946971.024591:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523035520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946971.024655:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523035520:12345-0@lo:400:kworker.0 Request processed in 64us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946971.024663:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946971.024679:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783946971.024686:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523035648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946971.024713:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523035648:12345-0@lo:400:kworker.0 Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946971.024736:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783946971.024776:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be844e00 x1870603523035648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946971.024791:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523035648:0@lo:400:kworker.0 00010000:00080000:2.0:1783946971.024802:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be845f80 x1870603523035520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946971.024809:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523035520:0@lo:400:kworker.0 00000100:00100000:1.0:1783946971.025345:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523035392:0@lo:400:kworker.0 00000100:00100000:1.0:1783946971.025392:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946971.025449:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523035392 00000100:00100000:1.0:1783946971.025454:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523035392 00000100:00100000:1.0:1783946971.025482:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783946971.025489:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:3448:x1870603523035392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946971.025527:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:3448:x1870603523035392:12345-0@lo:400:kworker.0 Request processed in 39us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946971.025534:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783946971.025578:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523035392:0@lo:400:kworker.0 00000100:00080000:1.0:1783946971.025625:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783946971.792240:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946972.695258:0:3446:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783946957/real 1783946957] req@ffff9137be93ed80 x1870603523031552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783946972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946972.695289:0:3446:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9137be93ed80 x1870603523031552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783946972 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946972.695300:0:3446:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783946957/real 1783946957] req@ffff9137be93d180 x1870603523031680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783946972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946972.695311:0:3446:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9137be93d180 x1870603523031680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783946972 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783946972.695330:0:3446:0:(import.c:65:import_set_state_nolock()) ffff913784354000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783946972.696947:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783946972.696958:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523031552:0@lo:8:kworker.0 00000100:00080000:3.0:1783946972.696970:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783946972.696980:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783946972.696983:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523031680:0@lo:8:kworker.0 00000100:00080000:1.0:1783946972.698383:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783946972.698390:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783946972.698393:0:36:0:(import.c:65:import_set_state_nolock()) ffff913784354000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783946972.698400:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 561 00000100:00080000:1.0:1783946972.698417:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783946972.698425:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff913784354000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946972.698673:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be93d180 x1870603523035904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783946972.698694:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783946972.698697:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783946972.698700:0:36:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783946972.698703:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 561 00000100:00080000:1.0:1783946972.698707:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783946972.698711:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9137b9cdd800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1783946972.698724:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be93ed80 x1870603523036032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783946972.698803:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523035776:0@lo:400:kworker.0 00000100:00100000:3.0:1783946972.699609:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523036288:0@lo:400:kworker.0 00000100:00100000:0.0:1783946972.701215:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603523036160:0@lo:400:kworker.0 00000100:00100000:3.0:1783946972.701848:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946972.703600:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523036288 00000100:00100000:2.0:1783946972.703612:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523036288 00000100:00100000:2.0:1783946972.705598:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783946972.705621:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523036288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946972.705729:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523036288:12345-0@lo:400:kworker.0 Request processed in 119us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946972.705737:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783946972.710121:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946972.711183:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523036160 00000100:00100000:0.0:1783946972.711194:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523036160 00000100:00100000:0.0:1783946972.711256:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783946972.711269:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603523036160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946972.711350:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603523036160:12345-0@lo:400:kworker.0 Request processed in 85us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946972.711359:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783946972.711388:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523035904:0@lo:8:kworker.0 00000100:00100000:0.0:1783946972.711426:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946972.711470:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523036032:0@lo:8:kworker.0 00000100:00100000:0.0:1783946972.711655:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783946972.711712:0:3448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be93d880 x1870603523036160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946972.711727:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603523036160:0@lo:400:kworker.0 00010000:00080000:2.0:1783946972.712670:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be93c700 x1870603523036288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946972.712683:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523036288:0@lo:400:kworker.0 00000100:00100000:2.0:1783946972.713133:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523035904 00000100:00100000:2.0:1783946972.713140:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523035904 00000100:00100000:2.0:1783946972.713176:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523036032 00000100:00100000:2.0:1783946972.713179:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523036032 00000100:00100000:2.0:1783946972.713192:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946972.713199:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3446:x1870603523035904:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783946972.713231:0:15775:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:2.0:1783946972.713272:0:15775:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db8475 00002000:00100000:2.0:1783946972.713288:0:15775:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9137a7c0c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783946972.713292:0:15775:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783946972.713296:0:15775:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783946972.713477:0:15775:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783946972.713503:0:15775:0:(import.c:65:import_set_state_nolock()) ffff9137a7c0d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783946972.714307:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3446:x1870603523035904:12345-0@lo:8:kworker.0 Request processed in 1103us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946972.714315:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783946972.714336:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be93d180 x1870603523035904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783946992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783946972.714340:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946972.714346:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3446:x1870603523036032:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783946972.714348:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783946972.714356:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00010000:00020000:2.0:1783946972.714362:0:15775:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1783946972.714365:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:1.0:1783946972.714366:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783946972.714371:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783946972.714374:0:3446:0:(import.c:65:import_set_state_nolock()) ffff913784354000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783946972.714401:0:3446:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783946972.714408:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523035904:0@lo:8:kworker.0 00000100:00100000:1.0:1783946972.714414:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523035776 00000100:00100000:1.0:1783946972.714422:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523035776 00000004:00080000:3.0:1783946972.714479:0:15014:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1783946972.714484:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783946972.714503:0:15014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15014:1870603523036544:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783946972.714542:0:15014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946972.714559:0:15014:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d63f840 going to sleep for 11 seconds 00000004:00080000:3.0:1783946972.714575:0:15013:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783946972.714607:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:3447:x1870603523035776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946972.714654:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:3447:x1870603523035776:12345-0@lo:400:kworker.0 Request processed in 163us (293us total) trans 0 rc 0/0 00000004:00080000:3.0:1783946972.714661:0:15013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 576633599849ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783946972.714661:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00080000:00080000:3.0:1783946972.714671:0:15013:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783946972.714706:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523036416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783946972.714739:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946972.714743:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523035776:0@lo:400:kworker.0 00000100:00100000:3.0:1783946972.714780:0:15776:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783946972.714787:0:15776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1783946972.716018:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523036544 00000100:00100000:1.0:1783946972.716026:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523036544 00000100:00080000:1.0:1783946972.716088:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946972.716446:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783946972.716455:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:15014:x1870603523036544:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783946972.720144:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523036416 00000100:00100000:0.0:1783946972.720160:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523036416 00000100:00100000:0.0:1783946972.720210:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783946972.720221:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3450:x1870603523036416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946972.720253:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923660800 avail 3692138496 00010000:00080000:3.0:1783946972.720615:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be8b2a00 x1870603523036416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783946988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946972.720642:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523036416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783946972.720825:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3450:x1870603523036416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 605us (6084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946972.720838:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1783946972.722774:0:14971:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1783946972.746784:0:16125:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1783946972.746796:0:16125:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1783946972.746801:0:16125:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:2.0:1783946972.747962:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3446:x1870603523036032:12345-0@lo:8:kworker.0 Request processed in 33609us (36302us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783946972.747975:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783946972.748035:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783946972.748040:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783946972.748045:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523036032:0@lo:8:kworker.0 00002000:00010000:1.0:1783946972.773500:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.773515:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.773535:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.773541:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.773547:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.773565:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.773583:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.773592:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.773619:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946972.774006:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946972.774014:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.774023:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946972.774028:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.774050:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.774103:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.774112:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e04157b/0x229d2ec450db847c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.774141:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.774143:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.774145:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.774385:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.774392:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774401:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.774404:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.774408:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774418:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774427:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774434:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774477:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783946972.774812:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.774818:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774828:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.774831:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.774835:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774844:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774852:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774859:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774874:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783946972.774883:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783946972.774887:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774895:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44c00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946972.774904:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774912:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774922:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774929:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ffc4684/0x229d2ec450db8483 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774942:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946972.774945:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774951:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946972.774955:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774962:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774971:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774977:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b991ab6/0x229d2ec450db848a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.774994:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.774996:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.774998:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.775496:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.775503:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775512:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.775516:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.775520:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775530:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775538:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775544:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775558:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783946972.775566:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946972.775570:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775588:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946972.775592:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775600:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775611:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775619:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079ae76c9/0x229d2ec450db8491 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.775632:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.775633:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.775635:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.775873:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.776610:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.776619:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.776630:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.776634:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.776639:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.776650:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.776667:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.776674:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.776733:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783946972.779464:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.779482:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.779501:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.779505:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.779511:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.779525:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.779535:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.779543:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.781992:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783946972.782008:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.782024:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44400 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946972.782030:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.782040:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.782083:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.782111:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000450f9ff4/0x229d2ec450db8498 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.782336:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946972.782339:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.782345:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946972.782347:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.782352:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.782360:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.782364:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.782364:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.782366:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.786618:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783946972.786637:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f437747/0x229d2ec450db849f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.787347:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.793517:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.793533:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.793552:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.793557:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.793564:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.793579:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.793590:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.793598:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.793619:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783946972.795399:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.795410:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.795430:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.795434:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.795441:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.795456:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.795467:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.795476:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.795496:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783946972.796494:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.796502:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796514:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.796518:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.796523:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796534:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796554:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796562:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796572:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783946972.796831:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.796837:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796846:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.796850:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.796855:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796864:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796872:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796879:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.796897:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1783946972.797132:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783946972.797140:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797150:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45a00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.797327:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797340:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797361:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797369:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000160f7a45/0x229d2ec450db84a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797389:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783946972.797393:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797401:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f44a00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.797404:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797424:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797434:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797442:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca79db8d/0x229d2ec450db84ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797455:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783946972.797458:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797464:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.797468:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797475:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797484:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797492:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f36fc1bc/0x229d2ec450db84b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797512:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946972.797516:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797523:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45c00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.797526:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797535:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797544:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797551:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068718a95/0x229d2ec450db84bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.797562:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.797564:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.797566:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.798365:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.798375:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.798388:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.798392:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.798398:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.798411:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.798420:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.798428:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.798448:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946972.798633:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946972.798639:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.798647:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137b9f45800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.798660:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.798668:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.798681:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.798688:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e308a6/0x229d2ec450db84c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.798702:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.798704:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.798705:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.798890:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.799368:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.799375:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.799387:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.799395:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.799400:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.799412:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.799421:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.799430:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.799445:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946972.800408:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946972.800418:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.800431:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b2000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.800436:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.800448:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.800466:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.800480:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067d72d21/0x229d2ec450db84c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.800501:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.800503:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.800505:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.800686:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.800694:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.800704:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.800709:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.800714:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.800727:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.800736:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.800751:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.800773:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946972.801021:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946972.801028:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.801046:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b3a00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946972.801050:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.801079:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.801101:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.801110:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003db494e6/0x229d2ec450db84d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.801129:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.801131:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.801133:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.802360:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.802370:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.802383:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.802386:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.802391:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.802404:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.802413:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.802420:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.802438:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946972.802821:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946972.802828:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.802837:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b3c00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.802841:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.802850:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.802864:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.802871:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bc1464a/0x229d2ec450db84d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.802889:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.802891:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.802893:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.803351:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.803358:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803372:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.803375:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.803380:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803390:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803398:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803406:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803424:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946972.803628:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946972.803634:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.803642:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b2c00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946972.803646:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.803654:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.803672:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.803679:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078f7029e/0x229d2ec450db84de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.803696:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.803698:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.803700:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946972.803761:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.803766:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803773:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.803776:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.803780:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803789:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803806:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803814:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.803858:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783946972.806655:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.806669:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.806688:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.806692:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.806699:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.806713:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.806724:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.806731:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806802:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783946972.806809:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806818:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b3000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.806823:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806831:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806847:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806855:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008980a0a/0x229d2ec450db84e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806871:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946972.806874:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806880:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b3600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.806883:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806890:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806913:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.806920:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.806922:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.806924:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.808794:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783946972.808805:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471c9dda/0x229d2ec450db84ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.809534:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946972.809691:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946972.809699:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.809713:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1783946972.809718:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946972.809725:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.809739:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.809749:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.809757:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.809777:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946972.809987:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946972.809993:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.810001:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9a00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946972.810006:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.810015:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.810030:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.810037:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003017f18d/0x229d2ec450db84f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.810086:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.810088:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.810101:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946972.810673:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946972.810679:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.810689:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1783946972.810693:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946972.810703:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.810713:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.810721:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.810729:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.810974:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946972.811432:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946972.811439:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.811448:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946972.811453:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.811462:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.811473:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.811481:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822209c3/0x229d2ec450db84fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.811495:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.811496:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.811498:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946972.811584:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946972.811590:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.811599:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1783946972.811602:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946972.811607:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.811617:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.811625:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.811643:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946972.811691:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783946972.813506:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946972.813517:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.813530:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1783946972.813534:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946972.813540:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.813552:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.813562:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.813569:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.817306:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783946972.817318:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.817343:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9c00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946972.817348:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.817358:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.817377:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.817384:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a16c7958/0x229d2ec450db8501 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.818774:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946972.818784:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.818797:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b2e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946972.818802:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.818812:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.818827:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.818837:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.818838:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946972.818842:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.820351:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783946972.820363:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b759e20/0x229d2ec450db8508 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.820453:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946972.821131:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783946972.821891:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946972.821900:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.821924:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=576s v=(0 0) 00010000:00010000:3.0:1783946972.821929:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946972.821935:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.821949:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.821959:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.821967:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946972.822019:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783946972.827552:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783946972.827566:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.827586:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=576s v=(0 0) 00010000:00010000:2.0:1783946972.827592:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946972.827599:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.827614:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.827639:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.827647:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829444:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783946972.829458:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829473:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946972.829479:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829491:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829514:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829523:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d699d0f8/0x229d2ec450db850f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829543:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946972.829547:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829553:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946972.829556:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829577:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829587:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.829595:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.829597:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.829599:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946972.829978:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783946972.829986:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045c5e0fb/0x229d2ec450db8516 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.830285:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783946972.832708:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783946972.832721:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.832739:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=576s v=(0 0) 00010000:00010000:2.0:1783946972.832744:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946972.832751:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.832766:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.832777:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.832799:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.832816:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783946972.834457:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783946972.834468:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.834482:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=576s v=(0 0) 00010000:00010000:2.0:1783946972.834487:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946972.834492:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.834504:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.834512:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.834519:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.834539:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783946972.835021:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783946972.835027:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835041:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=576s v=(0 0) 00010000:00010000:2.0:1783946972.835044:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946972.835048:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835075:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835084:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835100:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835116:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1783946972.835683:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783946972.835690:0:16125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835700:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=576s v=(0 0) 00010000:00010000:2.0:1783946972.835708:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946972.835713:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835722:0:16125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835742:0:16125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835748:0:16125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946972.835756:0:16125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1783946972.835786:0:16125:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1783946972.835884:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:15014:x1870603523036544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 119425us (121336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946972.835894:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783946972.835984:0:15014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15014:1870603523036544:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783946972.836000:0:15014:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1783946972.836047:0:15014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15014:1870603523036672:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783946972.836117:0:15014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946972.836317:0:15014:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d63f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783946972.836384:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523036672 00000100:00100000:2.0:1783946972.836391:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523036672 00000100:00100000:2.0:1783946972.836436:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946972.836444:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:15014:x1870603523036672:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783946972.836480:0:15776:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1783946972.837327:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783946972.837337:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837349:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946972.837354:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837364:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837384:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837392:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cab69aec/0x229d2ec450db851d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837429:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783946972.837433:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837440:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8400 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946972.837444:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837453:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837463:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837470:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd60b957/0x229d2ec450db8524 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837484:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783946972.837488:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837495:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946972.837498:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837516:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837527:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837534:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000225fcfd2/0x229d2ec450db852b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837547:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946972.837550:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837556:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9c00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946972.837559:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837567:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837577:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837584:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1226eeb/0x229d2ec450db8532 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946972.837608:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.837609:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.837611:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946972.837769:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783946972.849176:0:15771:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1783946972.849232:0:15771:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783946972.849406:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:15014:x1870603523036672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12958us (13284us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783946972.849420:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783946972.849486:0:15014:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783946972.849495:0:15014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15014:1870603523036672:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783946972.849512:0:15014:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:02000400:0.0:1783946972.864497:0:16139:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783946973.844256:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783946973.942144:0:16192:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783946973.942371:0:16192:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783946974.864862:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783946975.228199:0:16242:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783946975.228399:0:16242:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783946975.889318:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946976.912212:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946977.936836:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783946978.192250:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783946978.192258:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783946978.192262:0:36:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783946978.192271:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 576 00000100:00080000:0.0:1783946978.192277:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1783946978.192280:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523036928:0@lo:400:kworker.0 00000100:00100000:1.0:1783946978.192286:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523036800:0@lo:400:kworker.0 00000100:00080000:0.0:1783946978.192286:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9137b9cdd800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946978.192314:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be945c00 x1870603523037056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783946978.192432:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523037056:0@lo:8:kworker.0 00000100:00100000:1.0:1783946978.194250:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946978.194259:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946978.194321:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523037440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946978.194354:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946978.194391:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523037440 00000100:00100000:1.0:1783946978.194397:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523037440 00000100:00100000:1.0:1783946978.194439:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783946978.194445:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523037440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946978.194476:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1783946978.194506:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523037440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946978.194524:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783946978.194542:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946978.194563:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523036928 00000100:00100000:2.0:1783946978.194569:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523036928 00000100:00100000:1.0:1783946978.194593:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523037440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946978.194607:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783946978.194616:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523036928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946978.194663:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946978.194670:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523036928:12345-0@lo:400:kworker.0 Request processed in 55us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946978.194685:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783946978.194696:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523037184:0@lo:400:kworker.0 00000100:00100000:2.0:1783946978.194701:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523037056 00000100:00100000:2.0:1783946978.194705:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523037056 00000100:00100000:3.0:1783946978.194719:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946978.194727:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783946978.194734:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3446:x1870603523037056:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783946978.194735:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946978.194743:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523037312:0@lo:400:kworker.0 00010000:00020000:2.0:1783946978.194753:0:15775:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783946978.194758:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946978.194780:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523037184 00000100:00100000:3.0:1783946978.194783:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523037184 00000100:00100000:3.0:1783946978.194801:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523037312 00000100:00100000:3.0:1783946978.194802:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523037312 00000100:00100000:3.0:1783946978.194813:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783946978.194817:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523037184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946978.194839:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523037184:12345-0@lo:400:kworker.0 Request processed in 22us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946978.194843:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783946978.194852:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783946978.194855:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523037312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946978.194868:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523037312:12345-0@lo:400:kworker.0 Request processed in 14us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946978.194871:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1783946978.194889:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be944e00 x1870603523037312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946978.194897:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523037312:0@lo:400:kworker.0 00010000:00080000:3.0:1783946978.194902:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be947480 x1870603523037184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946978.194908:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523037184:0@lo:400:kworker.0 00000100:00080000:1.0:1783946978.194995:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946978.195024:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523036928:0@lo:400:kworker.0 00000100:00100000:0.0:1783946978.195245:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523036800 00000100:00100000:0.0:1783946978.195250:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523036800 00000100:00100000:0.0:1783946978.195285:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783946978.195295:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:3447:x1870603523036800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946978.195348:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:3447:x1870603523036800:12345-0@lo:400:kworker.0 Request processed in 56us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946978.195355:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783946978.195424:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523036800:0@lo:400:kworker.0 00000100:00100000:2.0:1783946978.200418:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3446:x1870603523037056:12345-0@lo:8:kworker.0 Request processed in 5672us (5742us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783946978.200433:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783946978.200447:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783946978.200452:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783946978.200456:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523037056:0@lo:8:kworker.0 00010000:00010000:1.0:1783946978.961168:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783946979.537002:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783946979.984235:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946981.008606:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783946981.657418:0:16587:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783946981.657423:0:16587:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783946981.657424:0:16587:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783946981.657658:0:16587:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9137a7c0f800 00000020:01000004:2.0:1783946981.657676:0:16587:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783946981.657689:0:16587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783946981.657706:0:16587:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9137ba31b380) 00000020:00000080:2.0:1783946981.657722:0:16587:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783946981.711408:0:16587:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783946981.713406:0:16587:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783946981.714143:0:16587:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783946981.714407:0:16587:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783946981.715308:0:16587:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783946981.715663:0:16587:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783946981.716009:0:16587:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1783946981.719103:0:16587:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783946981.719314:0:16587:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783946981.719339:0:16587:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783946981.719352:0:16587:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x229d2ec450db8540 00000020:01000004:3.0:1783946981.719358:0:16587:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783946981.719379:0:16587:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783946981.719383:0:16587:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783946981.719389:0:16587:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783946981.719415:0:16587:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1783946981.719420:0:16587:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1783946981.735801:0:16587:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783946981.735845:0:16587:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.118@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1783946981.735850:0:16587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783946981.735852:0:16587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783946981.735853:0:16587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946981.735855:0:16587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946981.735856:0:16587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946981.735857:0:16587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946981.735859:0:16587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946981.735861:0:16587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946981.735863:0:16587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783946981.735867:0:16587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1783946981.735870:0:16587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783946981.735876:0:16587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783946981.735877:0:16587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783946981.735878:0:16587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783946981.735879:0:16587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783946981.735880:0:16587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783946981.735881:0:16587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783946981.735882:0:16587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783946981.735882:0:16587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783946981.735914:0:16587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783946981.735936:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523037568:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783946981.740291:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946981.740432:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946981.741208:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523037568 00000100:00100000:1.0:1783946981.741218:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523037568 00000100:00100000:1.0:1783946981.741304:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783946981.741315:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:16587:x1870603523037568:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783946981.741363:0:14984:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783946981.741367:0:14984:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783946981.741371:0:14984:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783946981.741961:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:16587:x1870603523037568:12345-0@lo:253:mount.lustre.0 Request processed in 647us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.742117:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523037568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783946981.742131:0:16587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783946981.742149:0:16587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783946981.742151:0:16587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783946981.742152:0:16587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783946981.742153:0:16587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783946981.742155:0:16587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783946981.742156:0:16587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783946981.742158:0:16587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783946981.742159:0:16587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783946981.742160:0:16587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783946981.742182:0:16587:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9137a7c0f800 from lustre-OST0001 10000000:01000000:0.0:1783946981.742216:0:16587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783946981.742220:0:16587:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783946981.742226:0:16587:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff913792763380 local copy 00010000:00010000:0.0:1783946981.742237:0:16587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946981.742661:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523037696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783946981.742701:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946981.742815:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523037696 00000100:00100000:0.0:1783946981.742821:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523037696 00000100:00100000:1.0:1783946981.742958:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783946981.743080:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783946981.743089:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523037696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783946981.743162:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523037696:12345-0@lo:501:mount.lustre.0 Request processed in 74us (460us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783946981.743169:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783946981.743208:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137927800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.743221:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523037696:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783946981.743235:0:16587:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783946981.743252:0:16587:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783946981.743258:0:16587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.743276:0:16587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137bdca9400/0x229d2ec450db82ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db82f4 expref: -99 pid: 14970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783946981.743303:0:16587:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9137a7c0f800 10000000:01000000:0.0:1783946981.743308:0:16587:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783946981.743314:0:16587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783946981.743316:0:16587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783946981.745705:0:16587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783946981.745717:0:16587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783946981.747721:0:16587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.748213:0:16587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.748226:0:16587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946981.748254:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523037824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783946981.748802:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946981.749109:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137927800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946981.749755:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523037824 00000100:00100000:1.0:1783946981.749764:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523037824 00000100:00100000:1.0:1783946981.749831:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783946981.749841:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:16587:x1870603523037824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783946981.749857:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946981.749875:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137927b2c00/0x229d2ec450db854e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8547 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946981.749926:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137927b2c00/0x229d2ec450db854e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8547 expref: 17 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946981.749950:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137927b2c00/0x229d2ec450db854e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8547 expref: 17 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946981.749960:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137927b2c00, rc 0) 00000100:00100000:1.0:1783946981.750306:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523037824:12345-0@lo:101:mount.lustre.0 Request processed in 465us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946981.750315:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783946981.750425:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523037824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783946981.750444:0:16587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db854e expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.750455:0:16587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db854e expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783946981.752313:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783946981.753656:0:16587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783946981.757553:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783946981.757692:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783946981.757709:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783946981.757722:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783946981.757817:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783946981.757832:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783946981.757922:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783946981.757929:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783946981.758270:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523037952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783946981.758448:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946981.758559:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946981.758688:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523037952 00000100:00100000:1.0:1783946981.758695:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523037952 00000100:00100000:1.0:1783946981.758850:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783946981.758860:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523037952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783946981.759054:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523037952:12345-0@lo:501:mount.lustre.0 Request processed in 195us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946981.759096:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783946981.759188:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523037952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783946981.759227:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783946981.759272:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946981.759752:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137927800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946981.759804:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523038080 00000100:00100000:2.0:1783946981.759810:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523038080 00000100:00100000:3.0:1783946981.759855:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783946981.759868:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523038080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783946981.760925:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523038080:12345-0@lo:503:mount.lustre.0 Request processed in 1058us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946981.760935:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783946981.761125:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038080:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783946981.770459:0:16587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783946981.770671:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783946981.770826:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946981.770921:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137832fa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783946981.771242:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523038208 00000100:00100000:2.0:1783946981.771431:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523038208 00000100:00100000:3.0:1783946981.771686:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783946981.771706:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523038208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783946981.772588:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523038208:12345-0@lo:502:mount.lustre.0 Request processed in 869us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946981.772598:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783946981.772705:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783946981.772966:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783946981.773014:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783946981.773030:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783946981.773045:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783946981.773100:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783946981.773120:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783946981.773134:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783946981.773163:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783946981.773180:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1783946981.773213:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783946981.773273:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946981.774684:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137b9f54180 going to sleep for 11 seconds 00000100:00100000:1.0:1783946981.774881:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523038336 00000100:00100000:1.0:1783946981.774889:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523038336 00000100:00100000:1.0:1783946981.774948:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783946981.774959:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523038336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783946981.775434:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523038336:12345-0@lo:502:mount.lustre.0 Request processed in 476us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946981.775450:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783946981.775558:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783946981.775637:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1783946981.775651:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1783946981.776959:0:16591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783946981.777229:0:16591:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1783946981.777238:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783946981.777241:0:16591:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783946981.777323:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783946981.777340:0:16591:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9137ba3199c0) 00000020:00000080:2.0:1783946981.777365:0:16591:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783946981.777372:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783946981.777443:0:16591:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9137a7c0f800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783946981.777451:0:16591:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783946981.777468:0:16591:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x229d2ec450db855c 00010000:00010000:2.0:1783946981.791207:0:16591:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1783946981.791807:0:16591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1783946981.794226:0:16591:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1783946981.798468:0:16591:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783946981.798483:0:16591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946981.798489:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946981.798492:0:16591:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783946981.798496:0:16591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783946981.798501:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946981.798502:0:16591:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783946981.798506:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783946981.798508:0:16591:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783946981.798510:0:16591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946981.798513:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946981.798514:0:16591:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783946981.798517:0:16591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783946981.798519:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946981.798521:0:16591:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783946981.798524:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783946981.798559:0:16591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783946981.798562:0:16591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783946981.798563:0:16591:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783946981.798567:0:16591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1783946981.802037:0:16587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1783946981.802180:0:16587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783946981.802260:0:16587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8547 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db854e expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.802276:0:16587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137be3a9c00/0x229d2ec450db8547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db854e expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946981.803181:0:16587:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137a7c0f800 from 1 10000000:01000000:2.0:1783946981.803186:0:16587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783946981.803228:0:16587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.803240:0:16587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.803261:0:16587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783946981.803291:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783946981.803377:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946981.803427:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be32fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.803601:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523038464 00000100:00100000:0.0:1783946981.803610:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523038464 00000100:00100000:0.0:1783946981.803667:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783946981.803676:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:16587:x1870603523038464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783946981.803691:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946981.803704:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8563 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.803739:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8563 expref: 18 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.803751:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8563 expref: 18 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.803761:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8000, rc 0) 00000100:00100000:0.0:1783946981.803815:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523038464:12345-0@lo:101:mount.lustre.0 Request processed in 139us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.803821:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783946981.805513:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783946981.805542:0:16587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.805575:0:16587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783946981.815351:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783946981.815709:0:16587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783946981.816130:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783946981.816156:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783946981.816174:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783946981.816178:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783946981.816254:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783946981.816336:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946981.816382:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be32fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783946981.816524:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523038592 00000100:00100000:3.0:1783946981.816531:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523038592 00000100:00100000:3.0:1783946981.816589:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783946981.816600:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523038592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783946981.816737:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523038592:12345-0@lo:501:mount.lustre.0 Request processed in 138us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946981.816745:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783946981.818239:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783946981.818293:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783946981.818360:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946981.818395:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523038720 00000100:00100000:2.0:1783946981.818400:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523038720 00000100:00100000:2.0:1783946981.818440:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783946981.818449:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523038720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783946981.818549:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523038720:12345-0@lo:503:mount.lustre.0 Request processed in 100us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946981.818556:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783946981.820584:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be32fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783946981.820628:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783946981.824846:0:16587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783946981.825256:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783946981.825367:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946981.825423:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787c04180 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.825649:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523038848 00000100:00100000:0.0:1783946981.825657:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523038848 00000100:00100000:0.0:1783946981.825698:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783946981.825705:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913798483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523038848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946981.825836:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913798483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523038848:12345-0@lo:502:mount.lustre.0 Request processed in 131us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.825842:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783946981.826308:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783946981.826565:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783946981.826598:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783946981.826625:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783946981.826654:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783946981.826671:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783946981.826688:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783946981.826704:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783946981.826849:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1783946981.826886:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783946981.826949:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946981.826992:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff913782c88a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.827124:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523038976 00000100:00100000:0.0:1783946981.827129:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523038976 00000100:00100000:0.0:1783946981.827164:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783946981.827175:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913798483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523038976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946981.827276:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913798483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523038976:12345-0@lo:502:mount.lustre.0 Request processed in 101us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.827282:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783946981.827348:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523038976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783946981.827509:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783946981.827519:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783946981.828525:0:16595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946981.828534:0:16595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946981.828536:0:16595:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783946981.828541:0:16595:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9137a7c0f800 00000020:00000080:0.0:1783946981.828543:0:16595:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783946981.828550:0:16595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946981.828552:0:16595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946981.828553:0:16595:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783946981.828556:0:16595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946981.828558:0:16595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946981.828559:0:16595:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783946981.828562:0:16595:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9137a7c0f800 00000020:00000080:0.0:1783946981.828564:0:16595:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783946981.828621:0:16595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946981.828624:0:16595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946981.828625:0:16595:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783946981.828626:0:16595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783946981.828628:0:16595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946981.828629:0:16595:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783946981.828631:0:16595:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9137a7c0f800 00000020:00000080:0.0:1783946981.828632:0:16595:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783946981.828647:0:16595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783946981.828649:0:16595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783946981.828650:0:16595:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783946981.828652:0:16595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1783946981.828757:0:16587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783946981.828778:0:16587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783946981.828795:0:16587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.828804:0:16587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783946981.828842:0:16587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783946981.828844:0:16587:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9137a7c0f800 10000000:01000000:3.0:1783946981.828846:0:16587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9137a7c0f800 10000000:01000000:3.0:1783946981.828850:0:16587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783946981.828853:0:16587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9137a7c0f800 from 1 10000000:01000000:3.0:1783946981.828855:0:16587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783946981.828979:0:16587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db8571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.828989:0:16587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db8571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.828997:0:16587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db8571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946981.829012:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783946981.829054:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946981.829110:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379167d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.829165:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523039104 00000100:00100000:0.0:1783946981.829170:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523039104 00000100:00100000:0.0:1783946981.829202:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783946981.829215:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913798482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:16587:x1870603523039104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783946981.829224:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946981.829235:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137be3a8400/0x229d2ec450db8578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8571 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.829253:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137be3a8400/0x229d2ec450db8578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8571 expref: 19 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.829261:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137be3a8400/0x229d2ec450db8578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8571 expref: 19 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.829267:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137be3a8400, rc 0) 00000100:00100000:0.0:1783946981.829310:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913798482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523039104:12345-0@lo:101:mount.lustre.0 Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.829315:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783946981.829401:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783946981.829412:0:16587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db8571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8578 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.829419:0:16587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db8571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db8578 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783946981.842761:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1783946981.843420:0:16587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783946981.844196:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783946981.844222:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783946981.844236:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783946981.844249:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783946981.844261:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783946981.844274:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783946981.844286:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783946981.844297:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783946981.844310:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783946981.844323:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783946981.844345:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783946981.844358:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783946981.844370:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783946981.844382:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783946981.844395:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783946981.844420:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783946981.844449:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783946981.844461:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783946981.844473:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783946981.844484:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783946981.844495:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783946981.844506:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783946981.844516:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783946981.844527:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783946981.844537:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1783946981.844549:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1783946981.844560:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1783946981.844571:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1783946981.844582:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1783946981.844594:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1783946981.844604:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1783946981.844625:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1783946981.844639:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1783946981.844651:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1783946981.844661:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1783946981.844671:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1783946981.844682:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1783946981.844701:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1783946981.844706:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1783946981.844789:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783946981.844850:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946981.844897:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379167d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.845417:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523039232 00000100:00100000:0.0:1783946981.845423:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523039232 00000100:00100000:0.0:1783946981.845466:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783946981.845476:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913798480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523039232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783946981.845604:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913798480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523039232:12345-0@lo:501:mount.lustre.0 Request processed in 129us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.845612:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783946981.845626:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783946981.845662:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783946981.845704:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946981.845738:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff913782c88a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.845996:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523039360 00000100:00100000:0.0:1783946981.846001:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523039360 00000100:00100000:0.0:1783946981.846034:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783946981.846041:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523039360:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783946981.846156:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523039360:12345-0@lo:503:mount.lustre.0 Request processed in 114us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.846170:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783946981.846219:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039360:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783946981.846539:0:16587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783946981.846585:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946981.846612:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946981.846631:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523039488 00000100:00100000:0.0:1783946981.846633:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523039488 00000100:00100000:0.0:1783946981.846649:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783946981.846653:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523039488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946981.846702:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523039488:12345-0@lo:502:mount.lustre.0 Request processed in 48us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.846706:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783946981.846732:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0788a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.846741:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783946981.846887:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783946981.846910:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783946981.846924:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783946981.846947:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783946981.846964:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783946981.846979:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783946981.846989:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783946981.846996:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783946981.847003:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783946981.847011:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783946981.847017:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783946981.847024:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783946981.847031:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783946981.847045:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783946981.847052:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783946981.847093:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783946981.847111:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783946981.847123:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783946981.847134:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783946981.847146:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783946981.847156:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783946981.847167:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783946981.847178:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783946981.847191:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783946981.847203:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1783946981.847214:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1783946981.847227:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1783946981.847252:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1783946981.847267:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1783946981.847279:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1783946981.847292:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1783946981.847306:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1783946981.847318:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1783946981.847329:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1783946981.847342:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1783946981.847355:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1783946981.847366:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1783946981.847377:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1783946981.847388:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1783946981.847399:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1783946981.847420:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946981.847458:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946981.847487:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523039616 00000100:00100000:0.0:1783946981.847491:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523039616 00000100:00100000:0.0:1783946981.847515:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783946981.847528:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523039616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783946981.847598:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523039616:12345-0@lo:502:mount.lustre.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.847604:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783946981.847640:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a0788a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.847653:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523039616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783946981.847685:0:16587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1783946981.847698:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1783946981.848481:0:16600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783946981.848503:0:16600:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9137a31b8000) 00000020:00000080:2.0:1783946981.848524:0:16600:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1783946981.848688:0:16600:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9137a7c0f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783946981.848693:0:16600:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9137a7c0f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783946981.848696:0:16600:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9137a7c0f800 3 00010000:00080000:2.0:1783946981.848729:0:16600:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9137be50a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.118@tcp at head 00010000:00010000:2.0:1783946981.851259:0:16600:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1783946981.851368:0:16600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783946981.851411:0:16600:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783946981.851425:0:16600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x229d2ec450db8586 00000100:00080000:2.0:1783946981.851437:0:16600:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783946981.851442:0:16600:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9137be50a000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1783946981.851495:0:16600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be844a80 x1870603523039744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783946981.851535:0:16600:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783946981.851591:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3446:1870603523039744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783946981.851668:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946981.851727:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523039744 00000100:00100000:3.0:1783946981.851734:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523039744 00000100:00100000:2.0:1783946981.851758:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523039872:0@lo:400:kworker.0 00000100:00100000:3.0:1783946981.851764:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783946981.851771:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3446:x1870603523039744:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783946981.851793:0:14991:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 585 last 0 00000100:00100000:2.0:1783946981.851795:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1783946981.851822:0:14991:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x229d2ec450db858d 00000100:00080000:0.0:1783946981.851835:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000004:00100000:3.0:1783946981.851837:0:14991:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783946981.851840:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783946981.851843:0:37:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783946981.851848:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 582 00000100:00080000:0.0:1783946981.851852:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783946981.851856:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9137b9cdd800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946981.851868:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be946a00 x1870603523040000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783946981.851879:0:14991:0:(import.c:65:import_set_state_nolock()) ffff9137a31af800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783946981.851919:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523040128:0@lo:400:kworker.0 00000100:00100000:3.0:1783946981.851924:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1870603523039744:12345-0@lo:38:llog_process_th.0 Request processed in 152us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946981.851930:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783946981.851957:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946981.851985:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946981.851991:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523040256:0@lo:400:kworker.0 00000100:00100000:0.0:1783946981.852012:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946981.852032:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523040128 00000100:00100000:0.0:1783946981.852035:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523040128 00000100:00100000:0.0:1783946981.852055:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523040256 00000100:00100000:0.0:1783946981.852085:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523040256 00000100:00100000:0.0:1783946981.852106:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783946981.852118:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523040128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946981.852149:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523040128:12345-0@lo:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.852155:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783946981.852166:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783946981.852170:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523040256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946981.852190:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523040256:12345-0@lo:400:kworker.0 Request processed in 20us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.852195:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1783946981.852216:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783946981.852234:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be944000 x1870603523040256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946981.852248:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523040256:0@lo:400:kworker.0 00010000:00080000:0.0:1783946981.852256:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be945500 x1870603523040128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783946997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946981.852264:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523040128:0@lo:400:kworker.0 00000100:00100000:3.0:1783946981.852307:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523040000:0@lo:8:kworker.0 00000100:00100000:3.0:1783946981.852332:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946981.852351:0:15774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523039872 00000100:00100000:2.0:1783946981.852355:0:15774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523039872 00010000:00080000:3.0:1783946981.852367:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9137be844a80 x1870603523039744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783946991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946981.852375:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783946981.852381:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00100000:2.0:1783946981.852383:0:15774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523040000 00000100:00100000:2.0:1783946981.852385:0:15774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523040000 00000100:00080000:3.0:1783946981.852387:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783946981.852392:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783946981.852394:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137be50a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783946981.852398:0:15774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783946981.852399:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3446:1870603523039744:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783946981.852404:0:15774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523039872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946981.852446:0:15774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523039872:12345-0@lo:400:kworker.0 Request processed in 42us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946981.852452:0:15774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783946981.852462:0:15774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783946981.852466:0:15774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3446:x1870603523040000:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783946981.852503:0:15774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3446:x1870603523040000:12345-0@lo:8:kworker.0 Request processed in 34us (169us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783946981.852509:0:15774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783946981.852526:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523039872:0@lo:400:kworker.0 00000100:00100000:2.0:1783946981.852532:0:3446:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783946981.852535:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783946981.852538:0:3446:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783946981.852541:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523040000:0@lo:8:kworker.0 00000100:00080000:0.0:1783946981.852573:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1783946981.853260:0:16600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1783946981.853367:0:16587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783946981.853408:0:16587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783946981.853423:0:16587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db8571 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8578 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.853434:0:16587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797623400/0x229d2ec450db8571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8578 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783946981.853486:0:16587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783946981.853488:0:16587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783946981.853489:0:16587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946981.853491:0:16587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783946981.853492:0:16587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946981.853493:0:16587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946981.853495:0:16587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783946981.853496:0:16587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946981.853497:0:16587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783946981.853500:0:16587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783946981.853503:0:16587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783946981.853504:0:16587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783946981.853505:0:16587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783946981.853506:0:16587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783946981.853507:0:16587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783946981.853508:0:16587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783946981.853509:0:16587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783946981.853510:0:16587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783946981.853511:0:16587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783946981.853528:0:16587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783946981.853539:0:16587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523040384:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783946981.853573:0:16587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946981.853600:0:16587:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379167df00 going to sleep for 11 seconds 00000100:00100000:0.0:1783946981.853637:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523040384 00000100:00100000:0.0:1783946981.853641:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523040384 00000100:00100000:0.0:1783946981.853672:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783946981.853680:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523040384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783946981.853702:0:14985:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783946981.853716:0:14985:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783946981.855411:0:14985:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783946981.855431:0:14985:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783946981.855686:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:16587:x1870603523040384:12345-0@lo:253:mount.lustre.0 Request processed in 2002us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946981.855718:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783946981.855779:0:16587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39c72ff9-53ed-483b-b87f-ab321f5fef71:16587:1870603523040384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783946981.855793:0:16587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783946981.855802:0:16587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783946981.855804:0:16587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783946981.855806:0:16587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783946981.855807:0:16587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783946981.855808:0:16587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783946981.855809:0:16587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783946981.855811:0:16587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783946981.855813:0:16587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783946981.855814:0:16587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783946981.855831:0:16587:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1783946981.855994:0:15007:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783946981.856000:0:15007:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783946981.856029:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.856048:0:15007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8467 expref: 18 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.856087:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.856126:0:15007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db8467 expref: 18 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.856140:0:15007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db8467 expref: 18 pid: 14986 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946981.856154:0:15007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15007:1870603523040512:0@lo:104: 00000100:00100000:3.0:1783946981.856191:0:15007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946981.856229:0:15007:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379167d600 going to sleep for 11 seconds 00000100:00100000:2.0:1783946981.856305:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523040512 00000100:00100000:2.0:1783946981.856312:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523040512 00000100:00100000:2.0:1783946981.856398:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783946981.856408:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:15007:x1870603523040512:12345-0@lo:104: 00010000:00010000:2.0:1783946981.856434:0:14975:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.856522:0:14975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783946981.856529:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:15007:x1870603523040512:12345-0@lo:104: Request processed in 123us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946981.856550:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1783946981.856581:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946981.856587:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.856607:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8800 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783946981.856612:0:14980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.856621:0:14980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783946981.856642:0:14980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783946981.856649:0:14980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783946981.856705:0:14980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.856736:0:14980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783946981.856791:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.856799:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137bdca8800/0x229d2ec450db8467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db846e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946981.856829:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946981.856832:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783946981.856835:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523040640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783946981.856846:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946981.856906:0:15007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15007:1870603523040512:0@lo:104: 00010000:00010000:2.0:1783946981.856922:0:15007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946981.856956:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946981.859492:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523040640 00000100:00100000:0.0:1783946981.859501:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523040640 00010000:00010000:0.0:1783946981.859531:0:14977:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db8467 expref: 19 pid: 14986 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946981.859570:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783946981.859578:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3447:x1870603523040640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783946981.859590:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783946981.859595:0:14977:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db8467 expref: 19 pid: 14986 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859606:0:14977:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db8467 expref: 19 pid: 14986 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859622:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137bdca8e00/0x229d2ec450db846e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db8467 expref: 19 pid: 14986 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859636:0:14977:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859644:0:14977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783946981.859659:0:14977:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016426569s 00010000:00010000:0.0:1783946981.859669:0:14977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859677:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859684:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859690:0:14977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859696:0:14977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946981.859700:0:14977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859706:0:14977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859722:0:14977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946981.859731:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783946981.859747:0:15007:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.859758:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946981.859766:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622800/0x229d2ec450db8594 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946981.859796:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:3447:x1870603523040640:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946981.859802:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783946981.859834:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523040640:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1783946981.866629:0:16587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783946981.870415:0:16587:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783946981.870511:0:16587:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783946981.870552:0:16587:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783946981.870602:0:16587:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783946981.870632:0:16587:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783946981.870664:0:16587:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1783946981.872269:0:16587:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783946981.872570:0:16587:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783946982.034596:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783946982.861861:0:16651:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783946982.862047:0:16651:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783946983.056325:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946983.312473:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523040768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946983.312552:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946983.312663:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523040768 00000100:00100000:1.0:1783946983.312685:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523040768 00000100:00100000:1.0:1783946983.312759:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783946983.312772:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523040768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783946983.312807:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1783946983.312865:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523040768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946983.312872:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783946983.312938:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783946983.313155:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523040768:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1783946983.890965:0:14988:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783946983.890973:0:14988:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff913791b89000 from 8 10000000:01000000:0.0:1783946983.890979:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783946983.891033:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a9600/0x229d2ec450db859b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946983.891046:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137be3a9600/0x229d2ec450db859b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946983.891523:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137be3a9600/0x229d2ec450db859b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783946983.891550:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523040896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783946983.891616:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946983.891673:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137be32f240 going to sleep for 11 seconds 00000100:00100000:3.0:1783946983.893176:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523040896 00000100:00100000:3.0:1783946983.893190:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523040896 00000100:00100000:3.0:1783946983.893270:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783946983.893281:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:14988:x1870603523040896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783946983.893307:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946983.893325:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797623800/0x229d2ec450db85a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db859b expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946983.893353:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797623800/0x229d2ec450db85a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db859b expref: 19 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946983.893363:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797623800/0x229d2ec450db85a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db859b expref: 19 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946983.893373:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623800, rc 0) 00000100:00100000:3.0:1783946983.893436:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785479c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:14988:x1870603523040896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946983.893444:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783946983.893509:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523040896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783946983.893525:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137be3a9600/0x229d2ec450db859b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db85a2 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946983.893535:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137be3a9600/0x229d2ec450db859b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db85a2 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783946983.893592:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523041024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783946983.893626:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946983.893650:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137a4b1f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783946983.893985:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523041024 00000100:00100000:2.0:1783946983.893991:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523041024 00000100:00100000:2.0:1783946983.894031:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783946983.894040:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:14988:x1870603523041024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783946983.894056:0:14984:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783946983.894102:0:14984:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783946983.894105:0:14984:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783946983.894184:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:14988:x1870603523041024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946983.894192:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783946983.895361:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523041024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783946983.895437:0:14988:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783946983.895445:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137be3a9600/0x229d2ec450db859b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db85a2 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946983.895463:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137be3a9600/0x229d2ec450db859b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db85a2 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946984.080184:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946985.118253:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946986.129158:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783946986.897040:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783946986.897047:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783946986.897051:0:37:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783946986.897081:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9137b9cdd800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1783946986.898282:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39c72ff9-53ed-483b-b87f-ab321f5fef71:3449:1870603523041152:0@lo:400:kworker.0 00000100:00100000:0.0:1783946986.898358:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946986.898422:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783946986.898429:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523041280:0@lo:400:kworker.0 00000100:00100000:0.0:1783946986.898458:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946986.898504:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523041152 00000100:00100000:0.0:1783946986.898519:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523041152 00000100:00100000:0.0:1783946986.898566:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783946986.898575:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3449:x1870603523041152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946986.898639:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785479450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3449:x1870603523041152:12345-0@lo:400:kworker.0 Request processed in 65us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946986.898647:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783946986.898688:0:15774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523041280 00000100:00100000:0.0:1783946986.898691:0:15774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523041280 00000100:00100000:0.0:1783946986.898730:0:15774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783946986.898735:0:15774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523041280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946986.898769:0:15774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523041280:12345-0@lo:400:kworker.0 Request processed in 34us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946986.898774:0:15774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783946986.898795:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783946986.898825:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523041280:0@lo:400:kworker.0 00000100:00100000:0.0:1783946986.898836:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39c72ff9-53ed-483b-b87f-ab321f5fef71:3449:1870603523041152:0@lo:400:kworker.0 00000100:00100000:1.0:1783946986.900102:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9137be93dc00 x1870603523041408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783946986.900338:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523041536:0@lo:400:kworker.0 00000100:00100000:1.0:1783946986.900394:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946986.900426:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783946986.900432:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523041664:0@lo:400:kworker.0 00000100:00100000:1.0:1783946986.900478:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946986.900811:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523041792:0@lo:400:kworker.0 00000100:00100000:1.0:1783946986.901094:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946986.901221:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523041536 00000100:00100000:1.0:1783946986.901229:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523041536 00000100:00100000:1.0:1783946986.901392:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523041664 00000100:00100000:1.0:1783946986.901396:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523041664 00000100:00100000:1.0:1783946986.901421:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523041792 00000100:00100000:1.0:1783946986.901434:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523041792 00000100:00100000:1.0:1783946986.901455:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783946986.901463:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523041536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946986.901659:0:3446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523041408:0@lo:8:kworker.0 00000100:00100000:0.0:1783946986.901696:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946986.902223:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523041536:12345-0@lo:400:kworker.0 Request processed in 759us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946986.902648:0:14991:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783946986.902658:0:14991:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783946986.902677:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523041408 00000100:00100000:2.0:1783946986.902683:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523041408 00000100:00100000:2.0:1783946986.902710:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783946986.902715:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3446:x1870603523041408:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783946986.902740:0:15775:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:2.0:1783946986.902768:0:15775:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x229d2ec450db85a9 00002000:00100000:2.0:1783946986.902781:0:15775:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9137be50e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783946986.902786:0:15775:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1783946986.902790:0:15775:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783946986.902947:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783946986.902968:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783946986.902976:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523041664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946986.903016:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523041664:12345-0@lo:400:kworker.0 Request processed in 41us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946986.903023:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783946986.903034:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783946986.903041:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523041792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946986.903095:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523041792:12345-0@lo:400:kworker.0 Request processed in 55us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946986.903101:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00080000:2.0:1783946986.903462:0:15775:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783946986.903968:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783946986.904006:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be93f800 x1870603523041792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783946986.904022:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523041792:0@lo:400:kworker.0 00000100:00080000:2.0:1783946986.904092:0:15775:0:(import.c:65:import_set_state_nolock()) ffff9137be50d800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1783946986.904216:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be93fb80 x1870603523041664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946986.904227:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523041664:0@lo:400:kworker.0 00010000:00080000:0.0:1783946986.904345:0:3447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be93d500 x1870603523041536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783946986.904353:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523041536:0@lo:400:kworker.0 00000100:00100000:2.0:1783946986.904516:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3446:x1870603523041408:12345-0@lo:8:kworker.0 Request processed in 1791us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946986.904524:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783946986.915901:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be93dc00 x1870603523041408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783946986.915924:0:3446:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783946986.915956:0:3446:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783946986.915962:0:3446:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783946986.915968:0:3446:0:(import.c:65:import_set_state_nolock()) ffff9137b9cdd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783946986.915988:0:3446:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783946986.915995:0:3446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3446:1870603523041408:0@lo:8:kworker.0 00000004:00080000:3.0:1783946986.916697:0:15016:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1783946986.916724:0:15016:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15016:1870603523042048:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783946986.916786:0:15016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946986.916814:0:15016:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f9c0 going to sleep for 11 seconds 00000004:00080000:3.0:1783946986.916833:0:15015:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783946986.916948:0:15015:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 590835887029ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783946986.916955:0:15015:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783946986.916977:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946986.916987:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523041920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946986.917018:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946986.917223:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523041920 00000100:00100000:3.0:1783946986.917345:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523041920 00000100:00100000:3.0:1783946986.917401:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783946986.917410:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603523041920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783946986.917439:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1783946986.917497:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3449:x1870603523041920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946986.917505:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783946986.917730:0:15774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523042048 00000100:00100000:0.0:1783946986.917735:0:15774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523042048 00000100:00100000:0.0:1783946986.917763:0:15774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783946986.917770:0:15774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:15016:x1870603523042048:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1783946986.918018:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783946986.918050:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9137be8b0a80 x1870603523041920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783946986.918092:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523041920:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1783946986.937785:0:14971:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1783946986.945451:0:15774:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1783946986.945462:0:15774:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1783946986.945468:0:15774:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1783946986.964637:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783946986.964653:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.964673:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1783946986.964678:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783946986.964685:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.964703:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.964732:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.964741:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.964769:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946986.964804:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946986.964815:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.964827:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946986.964833:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.964843:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.964876:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.964885:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b49985e/0x229d2ec450db85b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.964909:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.964912:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.964913:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783946986.965708:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946986.965717:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.965745:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1783946986.965749:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946986.965754:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.965765:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.965773:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.965781:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.965805:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783946986.965844:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946986.965870:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.965974:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622c00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946986.965982:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.966012:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.966037:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.966045:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069867167/0x229d2ec450db85b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.966168:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946986.966171:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946986.966174:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783946986.966206:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946986.966215:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966226:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1783946986.966230:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946986.966234:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966244:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966276:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966285:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966304:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783946986.966665:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946986.966672:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966681:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1783946986.966684:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946986.966689:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966699:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966713:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966721:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966751:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783946986.966762:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783946986.966769:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966778:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946986.966783:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966793:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966811:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966818:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b99b7fbd/0x229d2ec450db85be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966834:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946986.966837:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966844:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623a00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946986.966847:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966877:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966898:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966905:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073447621/0x229d2ec450db85c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.966918:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.966919:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.966921:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783946986.967244:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946986.967250:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967258:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1783946986.967262:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946986.967266:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967275:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967283:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967296:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967308:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946986.967315:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946986.967318:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967325:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946986.967328:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967334:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967344:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967350:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967361:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.967363:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.967364:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946986.967621:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783946986.967748:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946986.967762:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967771:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1783946986.967774:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946986.967778:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967788:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967796:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967803:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.967825:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946986.967890:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946986.967898:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.967910:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946986.967915:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.967927:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.967941:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.967950:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db85d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946986.967992:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946986.967997:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946986.968000:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783946986.968203:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946986.968209:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.968218:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1783946986.968221:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946986.968225:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.968235:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.968250:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.968310:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.968332:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783946986.968730:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946986.968744:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.968759:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946986.968764:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.968777:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.968800:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.968828:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0bc6d46/0x229d2ec450db85da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.968871:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946986.968875:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946986.968878:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783946986.969386:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946986.969392:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.969400:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1783946986.969403:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946986.969406:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.969414:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.969419:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.969424:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.969449:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783946986.969662:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946986.969671:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.969682:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946986.969687:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.969697:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.969723:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.969732:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a505381c/0x229d2ec450db85e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.969754:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946986.969756:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946986.969757:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783946986.971770:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946986.971787:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.971803:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1783946986.971809:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946986.971815:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.971830:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.971841:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.971859:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.972700:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946986.972702:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783946986.972712:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.972727:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946986.972732:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.972743:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.972769:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.972779:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012d8bf99/0x229d2ec450db85e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.972807:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946986.972821:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946986.972824:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783946986.975607:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783946986.975621:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975639:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=590s v=(0 0) 00010000:00010000:3.0:1783946986.975650:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783946986.975655:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975669:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975676:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975681:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975704:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946986.975716:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946986.975721:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975726:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946986.975729:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975735:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975747:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975762:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f850677f/0x229d2ec450db85ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.975782:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.975784:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.975786:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946986.980654:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946986.980674:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980692:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946986.980698:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946986.980705:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980721:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980732:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980740:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980763:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783946986.980779:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783946986.980785:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980793:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:0.0:1783946986.980796:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980816:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980832:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980840:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eea24692/0x229d2ec450db85f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.980866:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946986.980868:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946986.980870:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946986.985932:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946986.985953:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.985978:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1783946986.985985:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946986.985993:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.986013:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.986025:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.986034:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.986092:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783946986.986109:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783946986.986116:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.986125:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b2200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783946986.986130:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.986163:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.986185:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.986193:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db85fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.986216:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946986.986218:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783946986.986222:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946986.988204:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946986.988223:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.988245:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1783946986.988252:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946986.988259:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.988276:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.988289:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.988309:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946986.988337:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946986.989842:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946986.989869:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.990187:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b3e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946986.990193:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.990203:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.991490:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.991639:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db8604 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.991673:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.991675:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.991678:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946986.991681:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946986.991699:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.991733:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946986.991738:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946986.991745:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.991764:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.991776:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.991793:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.991826:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946986.992595:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946986.992605:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.992616:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946986.992621:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.992632:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.992651:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.992658:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000847a6699/0x229d2ec450db860b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.992678:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.992679:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.992681:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946986.994037:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946986.994081:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.994107:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946986.994114:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946986.994123:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.994142:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.994157:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.994166:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.994194:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946986.994400:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946986.994413:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.994426:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9a00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946986.994431:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.994457:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.994473:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.994481:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003017f18d/0x229d2ec450db8612 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.995829:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.995835:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.995837:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946986.997503:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946986.997523:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.997556:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946986.997562:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946986.998975:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.999019:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.999033:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.999043:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946986.999084:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946986.999135:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946986.999153:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.999173:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946986.999179:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.999191:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.999218:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.999258:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe175354/0x229d2ec450db8619 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946986.999287:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.999290:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946986.999292:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946987.000219:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.000230:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.000248:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.000254:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.000260:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.000275:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.000301:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.000310:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.000330:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783946987.000944:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783946987.000955:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946987.000967:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:3.0:1783946987.000973:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946987.000982:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946987.000997:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946987.001004:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026531260/0x229d2ec450db8620 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946987.001023:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946987.001025:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783946987.001027:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946987.001624:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.001634:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.001649:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.001655:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.001662:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.001678:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.001690:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.001699:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.001737:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946987.001747:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946987.001755:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.001763:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a9400 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.001768:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.001776:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.001790:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.001797:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4b7ca46/0x229d2ec450db8627 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.001814:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.001815:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.001817:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946987.002287:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.002294:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002304:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.002308:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.002312:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002321:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002328:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002335:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002355:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946987.002643:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946987.002649:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.002671:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.002675:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.002682:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.002696:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783946987.002701:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783946987.002704:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4ed47cb/0x229d2ec450db862e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002710:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002722:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=590s v=(0 0) 00010000:00010000:2.0:1783946987.002725:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.002728:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.002732:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946987.002733:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.002740:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002751:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002759:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002767:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.002789:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783946987.003506:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.003512:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.003523:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.003526:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.003531:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.003541:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.003549:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.003565:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.003579:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783946987.004147:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.004154:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004164:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.004168:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.004172:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004181:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004189:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004196:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004204:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783946987.004483:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783946987.004492:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004500:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.004505:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004514:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004536:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004544:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215dc44d/0x229d2ec450db8635 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004562:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783946987.004566:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004573:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfa00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.004576:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004584:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004593:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004600:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008129347d/0x229d2ec450db863c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004612:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946987.004615:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004628:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.004631:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004637:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004647:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004654:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000849c657c/0x229d2ec450db8643 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.004668:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.004670:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.004672:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.004680:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946987.004803:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.004809:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004824:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.004827:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.004832:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004842:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004861:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004869:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.004941:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946987.005564:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946987.005570:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.005578:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfc00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.005582:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.005590:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.005608:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.005615:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031777a86/0x229d2ec450db864a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.005629:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.005630:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.005632:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946987.012352:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.012367:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.012384:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.012389:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.012397:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.012412:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.012435:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.012443:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.012463:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946987.012826:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946987.012834:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.012844:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bec00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.012858:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.012869:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.012888:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.012895:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fd03d05/0x229d2ec450db8651 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.012925:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.012927:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.012929:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946987.013823:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.013832:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.013846:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.013862:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.013867:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.013889:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.013899:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.013907:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.013941:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783946987.014179:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946987.014186:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.014195:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bea00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.014199:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.014208:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.014221:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.014229:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d47d320/0x229d2ec450db8658 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.014244:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.014246:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.014248:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783946987.015389:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.015402:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.015451:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.015456:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.015462:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.015476:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.015487:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.015495:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.015555:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783946987.017264:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783946987.017278:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.017294:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1783946987.017311:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783946987.017318:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.017332:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.017342:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946987.017350:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022795:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783946987.022814:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022862:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf000 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.022868:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022887:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022909:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022917:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000726c4647/0x229d2ec450db865f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022940:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946987.022944:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022950:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf400 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.022953:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022972:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022983:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.022999:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.023001:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.023005:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783946987.027525:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783946987.027540:0:15774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db8666 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.027678:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783946987.028829:0:15774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783946987.028844:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946987.028878:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=590s v=(0 0) 00010000:00010000:1.0:1783946987.028884:0:15774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783946987.028966:0:15774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946987.028985:0:15774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946987.028998:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946987.029006:0:15774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946987.029032:0:15774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783946987.029131:0:15774:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1783946987.029300:0:15774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:15016:x1870603523042048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 111522us (112504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946987.029326:0:15774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1783946987.029348:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783946987.029365:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.029380:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b2200 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783946987.029387:0:14980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.029398:0:14980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.029423:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.029431:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eebf81/0x229d2ec450db866d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946987.029456:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.029458:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946987.029460:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946987.030186:0:15016:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be8b3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15016:1870603523042048:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783946987.030211:0:15016:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1783946987.030276:0:15016:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be845500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15016:1870603523042176:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783946987.030340:0:15016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946987.030402:0:15016:0:(client.c:2702:ptlrpc_set_wait()) set ffff91378560b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783946987.030531:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523042176 00000100:00100000:0.0:1783946987.030538:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523042176 00000100:00100000:0.0:1783946987.030598:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783946987.030611:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:15016:x1870603523042176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783946987.030655:0:15775:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1783946987.039529:0:16588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1783946987.039584:0:16588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783946987.039810:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:15016:x1870603523042176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9197us (9464us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783946987.039823:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783946987.040034:0:15016:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783946987.040045:0:15016:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be845500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15016:1870603523042176:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783946987.040091:0:15016:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1783946987.152429:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783946988.149347:0:16942:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783946988.181206:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946988.432714:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523042304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946988.432794:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946988.433595:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523042304 00000100:00100000:3.0:1783946988.433604:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523042304 00000100:00100000:3.0:1783946988.433678:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783946988.433688:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523042304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783946988.433719:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00100000:3.0:1783946988.433788:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523042304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946988.433795:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783946988.433852:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523042304:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783946988.433890:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783946989.200226:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783946989.539099:0:16994:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783946989.539466:0:16994:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1783946989.781611:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783946990.225455:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783946990.610144:0:17044:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783946990.610538:0:17044:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783946991.015854:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946991.016026:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507315584 00000100:00100000:3.0:1783946991.016040:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507315584 00000100:00100000:3.0:1783946991.016137:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:3.0:1783946991.016147:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1870603507315584:12345-192.168.201.18@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783946991.016189:0:14986:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from b23526e0-a156-411e-b000-ed9bfa177bc8@192.168.201.18@tcp t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:3.0:1783946991.016228:0:14986:0:(genops.c:1406:class_connect()) connect: client b23526e0-a156-411e-b000-ed9bfa177bc8, cookie 0x229d2ec450db8674 00000100:00080000:3.0:1783946991.016404:0:14986:0:(import.c:65:import_set_state_nolock()) ffff9137a31ad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783946991.016503:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+5:2360:x1870603507315584:12345-192.168.201.18@tcp:250:mount.lustre.0 Request processed in 355us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946991.016511:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:3.0:1783946991.038658:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946991.038867:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507315712 00000100:00100000:0.0:1783946991.038880:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507315712 00000100:00100000:0.0:1783946991.038961:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:0.0:1783946991.038974:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+5:13695:x1870603507315712:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783946991.038998:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946991.039025:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bee00/0x229d2ec450db867b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f572265 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946991.039124:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bee00/0x229d2ec450db867b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572265 expref: 6 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946991.039138:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bee00/0x229d2ec450db867b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572265 expref: 6 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946991.039150:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bee00, rc 0) 00000100:00100000:0.0:1783946991.039234:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+6:13695:x1870603507315712:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 263us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946991.039242:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:2.0:1783946991.055283:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946991.059325:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507315840 00000100:00100000:0.0:1783946991.059346:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507315840 00000100:00100000:0.0:1783946991.059440:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:0.0:1783946991.059454:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+6:13695:x1870603507315840:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783946991.059651:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+6:13695:x1870603507315840:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 200us (4382us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783946991.059661:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:2.0:1783946991.062311:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946991.062418:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507315968 00000100:00100000:3.0:1783946991.062431:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507315968 00000100:00100000:3.0:1783946991.062511:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:3.0:1783946991.062523:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+6:13695:x1870603507315968:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783946991.062547:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946991.062587:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797623e00/0x229d2ec450db8682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f57226c expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.062627:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797623e00/0x229d2ec450db8682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57226c expref: 7 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.062642:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797623e00/0x229d2ec450db8682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57226c expref: 7 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.062654:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623e00, rc 0) 00000100:00100000:3.0:1783946991.062922:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+7:13695:x1870603507315968:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 398us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946991.062930:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:2.0:1783946991.090675:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946991.090915:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507316096 00000100:00100000:0.0:1783946991.090927:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507316096 00000100:00100000:0.0:1783946991.091013:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:0.0:1783946991.091024:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913785478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+7:13695:x1870603507316096:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783946991.091760:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913785478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+8:13695:x1870603507316096:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 732us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946991.091771:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:2.0:1783946991.098406:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946991.098533:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507316224 00000100:00100000:1.0:1783946991.098547:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507316224 00000100:00100000:1.0:1783946991.098623:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:1.0:1783946991.098636:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91378547b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+8:13695:x1870603507316224:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783946991.098887:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91378547b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+8:13695:x1870603507316224:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 252us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946991.098896:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:1.0:1783946991.104434:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946991.107658:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507316352 00000100:00100000:0.0:1783946991.107692:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507316352 00000100:00100000:0.0:1783946991.107791:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:0.0:1783946991.107805:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+8:13713:x1870603507316352:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783946991.108796:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+8:13713:x1870603507316352:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 978us (4368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946991.108816:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:2.0:1783946991.138648:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946991.139323:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507316480 00000100:00100000:3.0:1783946991.139339:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507316480 00000100:00100000:3.0:1783946991.139438:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:3.0:1783946991.139452:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+8:13713:x1870603507316480:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783946991.139692:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+8:13713:x1870603507316480:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 242us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946991.139702:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:2.0:1783946991.147658:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946991.148048:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507316608 00000100:00100000:0.0:1783946991.148110:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507316608 00000100:00100000:0.0:1783946991.148174:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:0.0:1783946991.148185:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+8:13695:x1870603507316608:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783946991.148204:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946991.148225:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35be400/0x229d2ec450db8689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f572296 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946991.148260:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35be400/0x229d2ec450db8689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572296 expref: 9 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946991.148273:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35be400/0x229d2ec450db8689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572296 expref: 9 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946991.148283:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35be400, rc 0) 00000100:00100000:0.0:1783946991.148383:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+9:13695:x1870603507316608:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 200us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946991.148393:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:2.0:1783946991.152418:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946991.152532:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507316736 00000100:00100000:1.0:1783946991.152545:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507316736 00000100:00100000:1.0:1783946991.152618:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:1.0:1783946991.152630:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+9:13695:x1870603507316736:12345-192.168.201.18@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783946991.152667:0:14985:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783946991.152699:0:14985:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783946991.152704:0:14985:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783946991.152707:0:14985:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783946991.152710:0:14985:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1783946991.157714:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+9:13695:x1870603507316736:12345-192.168.201.18@tcp:256:mount.lustre.0 Request processed in 5069us (5293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946991.157748:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:2.0:1783946991.162279:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946991.162654:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507316864 00000100:00100000:3.0:1783946991.162667:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507316864 00000100:00100000:3.0:1783946991.162737:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:3.0:1783946991.162749:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be803050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+9:13695:x1870603507316864:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783946991.162773:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946991.162874:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f57229d expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.162935:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57229d expref: 10 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.162950:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57229d expref: 10 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.162962:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623a00, rc 0) 00000100:00100000:3.0:1783946991.163045:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be803050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13695:x1870603507316864:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 298us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946991.163055:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:2.0:1783946991.180207:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946991.180427:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507316992 00000100:00100000:1.0:1783946991.180441:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507316992 00000100:00100000:1.0:1783946991.180513:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:1.0:1783946991.180526:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13695:x1870603507316992:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783946991.180735:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13695:x1870603507316992:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 211us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946991.180745:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:2.0:1783946991.189126:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946991.189265:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507317120 00000100:00100000:0.0:1783946991.189280:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507317120 00000100:00100000:0.0:1783946991.189367:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:0.0:1783946991.189379:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13695:x1870603507317120:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783946991.189589:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be800050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13695:x1870603507317120:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 211us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946991.189598:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:2.0:1783946991.218741:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946991.219577:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507317248 00000100:00100000:3.0:1783946991.219594:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507317248 00000100:00100000:3.0:1783946991.219682:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:3.0:1783946991.219696:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be802050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13718:x1870603507317248:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783946991.220195:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be802050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13718:x1870603507317248:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 498us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946991.220205:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:2.0:1783946991.229205:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946991.229563:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507317376 00000100:00100000:1.0:1783946991.229576:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507317376 00000100:00100000:1.0:1783946991.229651:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:1.0:1783946991.229665:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be803c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13718:x1870603507317376:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783946991.229897:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be803c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13718:x1870603507317376:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 235us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946991.229907:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:0.0:1783946991.245815:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946991.247657:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507317504 00000100:00100000:1.0:1783946991.247676:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507317504 00000100:00100000:1.0:1783946991.247761:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:1.0:1783946991.247772:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1870603507317504:12345-192.168.201.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783946991.247826:0:14992:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 22213d3f-d384-413a-8c5d-c8cad4f8a7c0@192.168.201.18@tcp t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:1.0:1783946991.247898:0:14992:0:(genops.c:1406:class_connect()) connect: client 22213d3f-d384-413a-8c5d-c8cad4f8a7c0, cookie 0x229d2ec450db8697 00000004:00100000:1.0:1783946991.247934:0:14992:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1783946991.247942:0:14992:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1783946991.248291:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783946991.266143:0:14992:0:(import.c:65:import_set_state_nolock()) ffff9137be613000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783946991.266417:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2360:x1870603507317504:12345-192.168.201.18@tcp:38:mount.lustre.0 Request processed in 18639us (20613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946991.266432:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:2.0:1783946991.282540:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946991.282676:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507317632 00000100:00100000:0.0:1783946991.282691:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507317632 00000100:00100000:0.0:1783946991.282801:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:0.0:1783946991.282823:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:0:x1870603507317632:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783946991.282881:0:14991:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446334464 avail 1300094976 00000100:00100000:0.0:1783946991.283014:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:0:x1870603507317632:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 194us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946991.283023:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00080000:1.0:1783946991.284515:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946991.287162:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946991.287837:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507317760 00000100:00100000:3.0:1783946991.287854:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507317760 00000100:00100000:3.0:1783946991.287939:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1783946991.287953:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:13695:x1870603507317760:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783946991.287998:0:14993:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1783946991.288163:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:13695:x1870603507317760:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 213us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946991.288174:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1783946991.297563:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946991.297948:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507317888 00000100:00100000:0.0:1783946991.297964:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507317888 00000100:00100000:0.0:1783946991.298096:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1783946991.298110:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:13695:x1870603507317888:12345-192.168.201.18@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783946991.300582:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:13695:x1870603507317888:12345-192.168.201.18@tcp:40:mount.lustre.0 Request processed in 2456us (5169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946991.300600:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1783946991.313677:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946991.313721:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946991.313759:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946991.314098:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507318272 00000100:00100000:3.0:1783946991.314112:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507318272 00000100:00100000:3.0:1783946991.314170:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:3.0:1783946991.314182:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:13695:x1870603507318272:12345-192.168.201.18@tcp:33:mount.lustre.0 00000100:00100000:1.0:1783946991.314629:0:15774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507318016 00000100:00100000:1.0:1783946991.314635:0:15774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507318016 00000100:00100000:1.0:1783946991.314670:0:15774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507318144 00000100:00100000:1.0:1783946991.314673:0:15774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507318144 00000100:00100000:1.0:1783946991.314691:0:15774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:1.0:1783946991.314698:0:15774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870603507318016:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783946991.314729:0:15774:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 22213d3f-d384-413a-8c5d-c8cad4f8a7c0@192.168.201.18@tcp t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:1.0:1783946991.314787:0:15774:0:(genops.c:1406:class_connect()) connect: client 22213d3f-d384-413a-8c5d-c8cad4f8a7c0, cookie 0x229d2ec450db869e 00002000:00100000:1.0:1783946991.314804:0:15774:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 22213d3f-d384-413a-8c5d-c8cad4f8a7c0/ffff9137be611000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783946991.314833:0:15774:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783946991.315095:0:15774:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783946991.315136:0:15774:0:(import.c:65:import_set_state_nolock()) ffff9137be615800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783946991.315225:0:15774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2360:x1870603507318016:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 526us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946991.315235:0:15774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:1.0:1783946991.315268:0:15774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1783946991.315273:0:15774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1870603507318144:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783946991.315292:0:15774:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 22213d3f-d384-413a-8c5d-c8cad4f8a7c0@192.168.201.18@tcp t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:1.0:1783946991.315312:0:15774:0:(genops.c:1406:class_connect()) connect: client 22213d3f-d384-413a-8c5d-c8cad4f8a7c0, cookie 0x229d2ec450db86a5 00002000:00100000:1.0:1783946991.315318:0:15774:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 22213d3f-d384-413a-8c5d-c8cad4f8a7c0/ffff9137be614000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783946991.315331:0:15774:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783946991.315452:0:15774:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783946991.315470:0:15774:0:(import.c:65:import_set_state_nolock()) ffff913792072000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783946991.315498:0:15774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2360:x1870603507318144:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 223us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946991.315505:0:15774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000004:00080000:2.0:1783946991.329935:0:14994:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15625us 00000004:00200000:2.0:1783946991.371765:0:14994:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783946991.372176:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:13695:x1870603507318272:12345-192.168.201.18@tcp:33:mount.lustre.0 Request processed in 57987us (58505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946991.372196:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1783946991.696044:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946991.696269:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507318400 00000100:00100000:3.0:1783946991.696288:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507318400 00000100:00100000:3.0:1783946991.696396:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1783946991.696418:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:13740:x1870603507318400:12345-192.168.201.18@tcp:101:mkdir.0 00010000:00010000:3.0:1783946991.696449:0:14993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783946991.696488:0:14993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622800/0x229d2ec450db86ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5722c7 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.696587:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db86b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.696604:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db86b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.696621:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db86b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783946991.696698:0:14993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783946991.696703:0:14993:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783946991.696760:0:14993:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db86b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.696811:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622800/0x229d2ec450db86ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722c7 expref: 8 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.696860:0:14993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db86b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722c7 expref: 7 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783946991.696870:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:3.0:1783946991.696874:0:14993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783946991.696878:0:14993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623000, rc 0) 00000100:00100000:3.0:1783946991.696982:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+7:13740:x1870603507318400:12345-192.168.201.18@tcp:101:mkdir.0 Request processed in 568us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946991.696990:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:1.0:1783946992.016657:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523042432:0@lo:400:kworker.0 00000100:00100000:0.0:1783946992.016701:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523042688:0@lo:400:kworker.0 00000100:00100000:3.0:1783946992.016857:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523042560:0@lo:400:kworker.0 00000100:00100000:2.0:1783946992.016904:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523042816:0@lo:400:kworker.0 00000100:00100000:0.0:1783946992.022085:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946992.022287:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523043200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783946992.023295:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946992.023702:0:15774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523042688 00000100:00100000:0.0:1783946992.023713:0:15774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523042688 00000100:00100000:0.0:1783946992.023892:0:15774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783946992.023905:0:15774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523042688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946992.023977:0:15774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523042688:12345-0@lo:400:kworker.0 Request processed in 75us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946992.023985:0:15774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783946992.024011:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783946992.024050:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523042688:0@lo:400:kworker.0 00000100:00100000:0.0:1783946992.024130:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523043200 00000100:00100000:0.0:1783946992.024134:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523043200 00000100:00100000:0.0:1783946992.024160:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783946992.024166:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523043200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783946992.024185:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783946992.024227:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523043200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946992.024233:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783946992.024265:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523043200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783946992.031756:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946992.031918:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603523042944:0@lo:400:kworker.0 00000100:00100000:1.0:1783946992.032005:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946992.032106:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523042944 00000100:00100000:1.0:1783946992.032115:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523042944 00000100:00100000:1.0:1783946992.032189:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783946992.032200:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603523042944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783946992.032268:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603523042944:12345-0@lo:400:kworker.0 Request processed in 70us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946992.032276:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1783946992.032304:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783946992.032344:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603523042944:0@lo:400:kworker.0 00000100:00100000:0.0:1783946992.032525:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523042432 00000100:00100000:0.0:1783946992.032531:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523042432 00000100:00100000:0.0:1783946992.032565:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783946992.032573:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3448:x1870603523042432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946992.032629:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be802c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3448:x1870603523042432:12345-0@lo:400:kworker.0 Request processed in 57us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946992.032637:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783946992.033004:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523042432:0@lo:400:kworker.0 00000100:00100000:3.0:1783946992.034136:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946992.034175:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523043072:0@lo:400:kworker.0 00000100:00100000:3.0:1783946992.034207:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946992.034212:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523042560 00000100:00100000:0.0:1783946992.034220:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523042560 00000100:00100000:0.0:1783946992.034299:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783946992.034311:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523042560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783946992.034371:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523042560:12345-0@lo:400:kworker.0 Request processed in 63us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946992.034378:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783946992.034470:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946992.034504:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523043072 00000100:00100000:3.0:1783946992.034510:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523043072 00000100:00100000:3.0:1783946992.034550:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523042816 00000100:00100000:3.0:1783946992.034554:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523042816 00000100:00100000:2.0:1783946992.034559:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523042560:0@lo:400:kworker.0 00000100:00100000:3.0:1783946992.034590:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783946992.034600:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523043072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946992.034601:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783946992.034617:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523042816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946992.034652:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523043072:12345-0@lo:400:kworker.0 Request processed in 54us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946992.034661:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783946992.034674:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3447:x1870603523042816:12345-0@lo:400:kworker.0 Request processed in 59us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946992.034682:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783946992.034698:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523043072:0@lo:400:kworker.0 00000100:00080000:1.0:1783946992.035632:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783946992.035641:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783946992.039318:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3447:1870603523042816:0@lo:400:kworker.0 00010000:00010000:2.0:1783946992.272462:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783946993.044368:0:16588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22213d3f-d384-413a-8c5d-c8cad4f8a7c0 00010000:00010000:2.0:1783946993.297903:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783946993.552551:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783946993.552585:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523043328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783946993.552686:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946993.552848:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523043328 00000100:00100000:0.0:1783946993.552859:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523043328 00000100:00100000:0.0:1783946993.552938:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783946993.552950:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523043328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946993.552997:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1783946993.553093:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523043328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946993.553103:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783946993.553640:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523043328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946994.311515:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946994.312028:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507318528 00000100:00100000:3.0:1783946994.312044:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507318528 00000100:00100000:3.0:1783946994.312268:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783946994.312281:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+7:13792:x1870603507318528:12345-192.168.201.18@tcp:41:lfs.0 00000004:00000024:3.0:1783946994.312350:0:14993:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1783946994.312506:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+7:13792:x1870603507318528:12345-192.168.201.18@tcp:41:lfs.0 Request processed in 228us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946994.312515:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783946994.318129:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946994.318304:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507318656 00000100:00100000:0.0:1783946994.318320:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507318656 00000100:00080000:1.0:1783946994.318444:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783946994.318451:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783946994.320029:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1783946994.320077:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:13792:x1870603507318656:12345-192.168.201.18@tcp:13:lfs.0 00002000:00000024:0.0:1783946994.320129:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1783946994.320307:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:13792:x1870603507318656:12345-192.168.201.18@tcp:13:lfs.0 Request processed in 259us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946994.320316:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1783946994.325476:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:1.0:1783946994.326390:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946994.331515:0:15779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507318784 00000100:00100000:2.0:1783946994.331549:0:15779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507318784 00000100:00100000:2.0:1783946994.331670:0:15779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1783946994.331683:0:15779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:13792:x1870603507318784:12345-192.168.201.18@tcp:13:lfs.0 00002000:00000024:2.0:1783946994.331767:0:15779:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1783946994.331876:0:15779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:13792:x1870603507318784:12345-192.168.201.18@tcp:13:lfs.0 Request processed in 196us (6418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946994.331884:0:15779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00080000:1.0:1783946994.331995:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783946994.648815:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946994.649043:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507318912 00000100:00100000:2.0:1783946994.649103:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507318912 00000100:00100000:2.0:1783946994.649177:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:2.0:1783946994.649189:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+10:13825:x1870603507318912:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783946994.649214:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783946994.649241:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137bdca8000/0x229d2ec450db86ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f5722ce expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946994.649282:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137bdca8000/0x229d2ec450db86ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ce expref: 11 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946994.649297:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137bdca8000/0x229d2ec450db86ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ce expref: 11 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783946994.649307:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8000, rc 0) 00000100:00100000:2.0:1783946994.649385:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13825:x1870603507318912:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 197us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946994.649394:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:3.0:1783946994.660174:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946994.665605:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507319040 00000100:00100000:1.0:1783946994.665629:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507319040 00000100:00100000:1.0:1783946994.665745:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:1.0:1783946994.665768:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13825:x1870603507319040:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783946994.666088:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13825:x1870603507319040:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 321us (5926us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946994.666098:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:3.0:1783946994.668468:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946994.671185:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507319168 00000100:00100000:0.0:1783946994.671220:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507319168 00000100:00100000:0.0:1783946994.671672:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:0.0:1783946994.671687:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13825:x1870603507319168:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783946994.671936:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13825:x1870603507319168:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 251us (3479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946994.671944:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:3.0:1783946994.707734:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946994.707993:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507319296 00000100:00100000:2.0:1783946994.708007:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507319296 00000100:00100000:2.0:1783946994.708132:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:2.0:1783946994.708146:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13831:x1870603507319296:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783946994.708350:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13831:x1870603507319296:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 207us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946994.708365:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:3.0:1783946994.741994:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946994.742247:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507319424 00000100:00100000:0.0:1783946994.742260:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507319424 00000100:00100000:0.0:1783946994.742335:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:0.0:1783946994.742380:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13831:x1870603507319424:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783946994.742582:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13831:x1870603507319424:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 204us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946994.742591:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:3.0:1783946994.753646:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946994.754124:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507319552 00000100:00100000:1.0:1783946994.754136:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507319552 00000100:00100000:1.0:1783946994.754198:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:1.0:1783946994.754210:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13825:x1870603507319552:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783946994.754232:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783946994.754256:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137927b2200/0x229d2ec450db86c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f5722f8 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946994.754292:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137927b2200/0x229d2ec450db86c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722f8 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946994.754305:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137927b2200/0x229d2ec450db86c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722f8 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783946994.754316:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137927b2200, rc 0) 00000100:00100000:1.0:1783946994.754404:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13825:x1870603507319552:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 195us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946994.754412:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:3.0:1783946994.764164:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946994.764343:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507319680 00000100:00100000:2.0:1783946994.764369:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507319680 00000100:00100000:2.0:1783946994.764457:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:2.0:1783946994.764469:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be431c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13825:x1870603507319680:12345-192.168.201.18@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783946994.764507:0:14986:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783946994.764898:0:14986:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783946994.764904:0:14986:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783946994.764908:0:14986:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783946994.764911:0:14986:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783946994.772232:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be431c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13825:x1870603507319680:12345-192.168.201.18@tcp:256:mount.lustre.0 Request processed in 7749us (8070us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946994.772251:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:3.0:1783946994.776828:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946994.777146:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507319808 00000100:00100000:0.0:1783946994.777162:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507319808 00000100:00100000:0.0:1783946994.777264:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:0.0:1783946994.777278:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13825:x1870603507319808:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783946994.777306:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946994.777338:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f5722ff expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946994.777389:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ff expref: 13 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946994.777418:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ff expref: 13 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946994.777454:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf200, rc 0) 00000100:00100000:0.0:1783946994.777571:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13825:x1870603507319808:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 294us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946994.777580:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:3.0:1783946994.781126:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946994.784181:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507319936 00000100:00100000:2.0:1783946994.784207:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507319936 00000100:00100000:2.0:1783946994.784324:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:2.0:1783946994.784339:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13825:x1870603507319936:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783946994.784826:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13825:x1870603507319936:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 488us (3967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946994.784835:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:3.0:1783946994.787683:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946994.787797:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507320064 00000100:00100000:1.0:1783946994.787830:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507320064 00000100:00100000:1.0:1783946994.787907:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:1.0:1783946994.787920:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13825:x1870603507320064:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783946994.794674:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13825:x1870603507320064:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 6734us (6984us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946994.794695:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:3.0:1783946994.800419:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946994.806939:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507320192 00000100:00100000:0.0:1783946994.806963:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507320192 00000100:00100000:0.0:1783946994.807076:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:0.0:1783946994.807090:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13836:x1870603507320192:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783946994.807343:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13836:x1870603507320192:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 255us (6942us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946994.807352:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:0.0:1783946994.810476:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783946994.810599:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507320320 00000100:00100000:1.0:1783946994.810612:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507320320 00000100:00100000:1.0:1783946994.810682:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:1.0:1783946994.810694:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13836:x1870603507320320:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783946994.814096:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13836:x1870603507320320:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 3383us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946994.814115:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:3.0:1783946994.845289:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946994.845653:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507320448 00000100:00100000:2.0:1783946994.845667:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507320448 00000100:00100000:2.0:1783946994.845750:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1783946994.845762:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1870603507320448:12345-192.168.201.18@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783946994.845804:0:14991:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 5c8e7909-7a17-4460-a5a7-eed91d187745@192.168.201.18@tcp t0 exp 0000000000000000 cur 598 last 0 00000020:00000080:2.0:1783946994.845867:0:14991:0:(genops.c:1406:class_connect()) connect: client 5c8e7909-7a17-4460-a5a7-eed91d187745, cookie 0x229d2ec450db86cf 00000004:00100000:2.0:1783946994.845902:0:14991:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783946994.846028:0:14991:0:(import.c:65:import_set_state_nolock()) ffff9137be90c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783946994.846162:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2360:x1870603507320448:12345-192.168.201.18@tcp:38:mount.lustre.0 Request processed in 400us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946994.846171:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1783946994.852078:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783946994.852120:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946994.864547:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507320704 00000100:00100000:3.0:1783946994.864569:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507320704 00000100:00080000:1.0:1783946994.864803:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783946994.865486:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507320576 00000100:00100000:3.0:1783946994.865496:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507320576 00000100:00100000:3.0:1783946994.865541:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1783946994.865554:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+7:13825:x1870603507320704:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783946994.865618:0:14993:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1783946994.865738:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+7:13825:x1870603507320704:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 186us (13700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946994.865816:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1783946994.865839:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1783946994.865847:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+6:0:x1870603507320576:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783946994.865859:0:14993:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1783946994.865881:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+6:0:x1870603507320576:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 35us (13761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946994.865887:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1783946994.869442:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946994.869664:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507320832 00000100:00100000:3.0:1783946994.869678:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507320832 00000100:00100000:3.0:1783946994.869767:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1783946994.869780:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+6:13825:x1870603507320832:12345-192.168.201.18@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783946994.869898:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+6:13825:x1870603507320832:12345-192.168.201.18@tcp:40:mount.lustre.0 Request processed in 120us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946994.869907:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1783946994.873942:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946994.874363:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946994.874404:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783946994.874447:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507320960 00000100:00100000:3.0:1783946994.874460:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507320960 00000100:00100000:3.0:1783946994.874509:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507321088 00000100:00100000:3.0:1783946994.874513:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507321088 00000100:00100000:3.0:1783946994.874536:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1783946994.874547:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1870603507320960:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783946994.874611:0:15775:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5c8e7909-7a17-4460-a5a7-eed91d187745@192.168.201.18@tcp t0 exp 0000000000000000 cur 598 last 0 00000020:00000080:3.0:1783946994.874657:0:15775:0:(genops.c:1406:class_connect()) connect: client 5c8e7909-7a17-4460-a5a7-eed91d187745, cookie 0x229d2ec450db86d6 00002000:00100000:3.0:1783946994.874673:0:15775:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5c8e7909-7a17-4460-a5a7-eed91d187745/ffff9137a31af000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783946994.874687:0:15775:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783946994.874810:0:15775:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783946994.874849:0:15775:0:(import.c:65:import_set_state_nolock()) ffff9137a31ac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783946994.874928:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2360:x1870603507320960:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 382us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946994.874937:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1783946994.874956:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1783946994.874961:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1870603507321088:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783946994.874977:0:15775:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5c8e7909-7a17-4460-a5a7-eed91d187745@192.168.201.18@tcp t0 exp 0000000000000000 cur 598 last 0 00000020:00000080:3.0:1783946994.874996:0:15775:0:(genops.c:1406:class_connect()) connect: client 5c8e7909-7a17-4460-a5a7-eed91d187745, cookie 0x229d2ec450db86dd 00002000:00100000:3.0:1783946994.875001:0:15775:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5c8e7909-7a17-4460-a5a7-eed91d187745/ffff9137a31aa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783946994.875008:0:15775:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783946994.875117:0:15775:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783946994.875133:0:15775:0:(import.c:65:import_set_state_nolock()) ffff9137a31a8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783946994.875156:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2360:x1870603507321088:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 193us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946994.875163:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1783946994.876500:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507321216 00000100:00100000:0.0:1783946994.876518:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507321216 00000100:00100000:0.0:1783946994.876594:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:0.0:1783946994.876606:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+6:13825:x1870603507321216:12345-192.168.201.18@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783946994.876754:0:14995:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783946994.876862:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+6:13825:x1870603507321216:12345-192.168.201.18@tcp:33:mount.lustre.0 Request processed in 257us (2934us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946994.876870:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1783946995.177227:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783946995.180927:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507321344 00000100:00100000:0.0:1783946995.180949:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507321344 00000100:00100000:0.0:1783946995.181116:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1783946995.181131:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+6:13857:x1870603507321344:12345-192.168.201.18@tcp:101:mkdir.0 00010000:00010000:0.0:1783946995.181177:0:16834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783946995.181214:0:16834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db86e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572329 expref: -99 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946995.181308:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946995.181328:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946995.181347:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783946995.181419:0:16834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783946995.181425:0:16834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783946995.181453:0:16834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946995.181668:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db86e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572329 expref: 8 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946995.181695:0:16834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572329 expref: 7 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783946995.181704:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:0.0:1783946995.181707:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783946995.181723:0:16834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35be200, rc 0) 00000100:00100000:0.0:1783946995.183321:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+7:13857:x1870603507321344:12345-192.168.201.18@tcp:101:mkdir.0 Request processed in 2179us (6094us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946995.183335:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00010000:00010000:2.0:1783946995.347668:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946996.371049:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946997.139819:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783946997.139868:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523043456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783946997.139983:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783946997.140285:0:15779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523043456 00000100:00100000:1.0:1783946997.140297:0:15779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523043456 00000100:00100000:1.0:1783946997.140380:0:15779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783946997.140392:0:15779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523043456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783946997.140456:0:15779:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1783946997.140518:0:15779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523043456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783946997.140526:0:15779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1783946997.140772:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783946997.140826:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523043456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783946997.142218:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603523043968:0@lo:400:kworker.0 00000100:00100000:3.0:1783946997.142296:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946997.142347:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783946997.142354:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603523043840:0@lo:400:kworker.0 00000100:00100000:3.0:1783946997.142378:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783946997.142629:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523043968 00000100:00100000:2.0:1783946997.142639:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523043968 00000100:00100000:2.0:1783946997.142712:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523043840 00000100:00100000:2.0:1783946997.142715:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523043840 00000100:00100000:2.0:1783946997.142742:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783946997.142754:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603523043968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946997.142824:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3448:x1870603523043968:12345-0@lo:400:kworker.0 Request processed in 72us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946997.142834:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783946997.142853:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783946997.142859:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603523043840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946997.142886:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3448:x1870603523043840:12345-0@lo:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946997.142900:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1783946997.142920:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946997.142965:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3448:1870603523043840:0@lo:400:kworker.0 00000100:00100000:2.0:1783946997.142977:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3448:1870603523043968:0@lo:400:kworker.0 00000100:00100000:3.0:1783946997.143046:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39c72ff9-53ed-483b-b87f-ab321f5fef71:3449:1870603523043584:0@lo:400:kworker.0 00000100:00100000:3.0:1783946997.143124:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946997.143159:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523044096:0@lo:400:kworker.0 00000100:00100000:3.0:1783946997.143372:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946997.143398:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783946997.143526:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b65aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523043712:0@lo:400:kworker.0 00000100:00100000:3.0:1783946997.143562:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783946997.143612:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523044096 00000100:00100000:3.0:1783946997.143617:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523044096 00000100:00100000:3.0:1783946997.143656:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783946997.143663:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523044096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946997.143717:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1870603523044096:12345-0@lo:400:kworker.0 Request processed in 54us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946997.143724:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783946997.143748:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523043712 00000100:00100000:3.0:1783946997.143752:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523043712 00000100:00100000:3.0:1783946997.143783:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783946997.143790:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523043712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783946997.143824:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523043712:12345-0@lo:400:kworker.0 Request processed in 36us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783946997.143831:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783946997.143868:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523043712:0@lo:400:kworker.0 00000100:00100000:3.0:1783946997.143878:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3449:1870603523044096:0@lo:400:kworker.0 00000100:00100000:2.0:1783946997.145241:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523043584 00000100:00100000:2.0:1783946997.145257:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523043584 00000100:00100000:2.0:1783946997.145306:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783946997.145316:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be433850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3449:x1870603523043584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783946997.145389:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be433850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3449:x1870603523043584:12345-0@lo:400:kworker.0 Request processed in 74us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783946997.145397:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1783946997.145463:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783946997.145470:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783946997.145519:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b65a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39c72ff9-53ed-483b-b87f-ab321f5fef71:3449:1870603523043584:0@lo:400:kworker.0 00000001:00100000:1.0:1783946997.158903:0:15771:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5c8e7909-7a17-4460-a5a7-eed91d187745 00000001:00100000:1.0:1783946997.158925:0:15771:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 22213d3f-d384-413a-8c5d-c8cad4f8a7c0 00000001:00100000:1.0:1783946997.165309:0:14971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5c8e7909-7a17-4460-a5a7-eed91d187745 00000001:00100000:1.0:1783946997.165330:0:14971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 22213d3f-d384-413a-8c5d-c8cad4f8a7c0 00010000:00010000:1.0:1783946997.410574:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783946998.425862:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783946998.672603:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783946998.672639:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523044224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783946998.672770:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783946998.673171:0:15779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523044224 00000100:00100000:0.0:1783946998.673183:0:15779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523044224 00000100:00100000:0.0:1783946998.673256:0:15779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783946998.673267:0:15779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523044224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783946998.673309:0:15779:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1783946998.673386:0:15779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523044224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1783946998.673395:0:15779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783946998.673453:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523044224:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1783946998.891965:0:17142:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783946999.440610:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947000.016570:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783947000.196535:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947000.196588:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947000.196604:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507321472 00000100:00100000:0.0:1783947000.196617:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507321472 00000100:00100000:3.0:1783947000.196645:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947000.196689:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947000.196700:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 104 00000100:00100000:0.0:1783947000.196713:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+13:2362:x1870603507321472:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947000.196727:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947000.196789:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+13:2362:x1870603507321472:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947000.196795:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 104 00000100:00100000:3.0:1783947000.199108:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947000.202847:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947000.202921:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507321728 00000100:00100000:3.0:1783947000.202934:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507321728 00000100:00100000:3.0:1783947000.203013:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507322240 00000100:00100000:3.0:1783947000.203017:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507322240 00000100:00100000:3.0:1783947000.203034:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507321856 00000100:00100000:3.0:1783947000.203037:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507321856 00000100:00100000:3.0:1783947000.203050:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507322112 00000100:00100000:3.0:1783947000.203052:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507322112 00000100:00100000:3.0:1783947000.203101:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1783947000.203114:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507321728:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947000.203212:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507321728:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 101us (6622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947000.203221:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1783947000.203243:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1783947000.203250:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2362:x1870603507322240:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947000.203278:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2362:x1870603507322240:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (6590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947000.203284:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1783947000.203297:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1783947000.203321:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507321856:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947000.203349:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507321856:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 29us (4497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947000.203355:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1783947000.203367:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783947000.203372:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507322112:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947000.203395:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507322112:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947000.203400:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783947000.203421:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507321984 00000100:00100000:3.0:1783947000.203425:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507321984 00000100:00100000:3.0:1783947000.203454:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507321600 00000100:00100000:3.0:1783947000.203457:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507321600 00000100:00100000:3.0:1783947000.203477:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1783947000.203484:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2362:x1870603507321984:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947000.203514:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2362:x1870603507321984:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 31us (6872us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947000.203522:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1783947000.203534:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:3.0:1783947000.203541:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2362:x1870603507321600:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947000.203565:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2362:x1870603507321600:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (6841us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947000.203571:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00080000:3.0:1783947000.206507:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947000.206544:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947000.206551:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783947000.474819:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783947001.234893:0:16588:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5c8e7909-7a17-4460-a5a7-eed91d187745 00010000:00010000:1.0:1783947001.488816:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947002.256416:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523044608:0@lo:400:kworker.0 00000100:00100000:0.0:1783947002.256522:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947002.256617:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947002.256624:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523044736:0@lo:400:kworker.0 00000100:00100000:0.0:1783947002.256655:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947002.258181:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523044352:0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.258258:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947002.258311:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523044864:0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.258339:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947002.258368:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783947002.258375:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523044480:0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.258401:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947002.258420:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523044992:0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.258440:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947002.258481:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523044608 00000100:00100000:3.0:1783947002.258492:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523044608 00000100:00100000:3.0:1783947002.258556:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523044480 00000100:00100000:3.0:1783947002.258559:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523044480 00000100:00100000:3.0:1783947002.258586:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947002.258610:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523044608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.258682:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523044608:12345-0@lo:400:kworker.0 Request processed in 73us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947002.258690:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947002.258711:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947002.258717:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.258749:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523044480:12345-0@lo:400:kworker.0 Request processed in 32us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947002.258755:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947002.258775:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523044736 00000100:00100000:3.0:1783947002.258778:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523044736 00000100:00100000:3.0:1783947002.258825:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523044864 00000100:00100000:3.0:1783947002.258828:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523044864 00000100:00100000:3.0:1783947002.258841:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523044992 00000100:00100000:3.0:1783947002.258844:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523044992 00000100:00100000:3.0:1783947002.258860:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947002.258865:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523044736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.258898:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523044736:12345-0@lo:400:kworker.0 Request processed in 33us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947002.258917:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947002.258929:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947002.258935:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523044864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.258967:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3447:x1870603523044864:12345-0@lo:400:kworker.0 Request processed in 32us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947002.258973:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947002.258984:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783947002.258989:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523044992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.259012:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3447:x1870603523044992:12345-0@lo:400:kworker.0 Request processed in 23us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947002.259018:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1783947002.259045:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947002.259051:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947002.259053:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947002.259137:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523044480:0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.259149:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3447:1870603523044992:0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.259159:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3447:1870603523044864:0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.259197:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523044736:0@lo:400:kworker.0 00000100:00100000:3.0:1783947002.259221:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523044608:0@lo:400:kworker.0 00000100:00100000:0.0:1783947002.259374:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523044352 00000100:00100000:0.0:1783947002.259379:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523044352 00000100:00100000:0.0:1783947002.259416:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783947002.259424:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3447:x1870603523044352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947002.259481:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3447:x1870603523044352:12345-0@lo:400:kworker.0 Request processed in 58us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947002.259497:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783947002.259544:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39c72ff9-53ed-483b-b87f-ab321f5fef71:3447:1870603523044352:0@lo:400:kworker.0 00000100:00100000:0.0:1783947002.265135:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947002.265169:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523045120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947002.265269:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947002.265346:0:15779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523045120 00000100:00100000:0.0:1783947002.265355:0:15779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523045120 00000100:00100000:0.0:1783947002.265422:0:15779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783947002.265432:0:15779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523045120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947002.265474:0:15779:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783947002.265530:0:15779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523045120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947002.265538:0:15779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783947002.265608:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523045120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783947002.512403:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947003.485364:0:17290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb229c3b0 20000000:00000080:2.0:1783947003.485397:0:17290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9137a30d2800 uarg=0000000000000000 20000000:01000000:2.0:1783947003.485464:0:17290:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783947003.485472:0:17290:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783947003.485491:0:17290:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783947003.486427:0:17291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1783947003.486715:0:17290:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783947003.496154:0:17290:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783947003.497125:0:17290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497156:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db83e2 expref: 18 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497164:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db842f expref: 18 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497171:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8563 expref: 18 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497183:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57229d expref: 12 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497191:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ff expref: 12 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497200:0:17290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497267:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ff expref: 12 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497286:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ff expref: 12 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947003.497305:0:17290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be549880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045248:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783947003.497458:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57229d expref: 12 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497484:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57229d expref: 12 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947003.497493:0:17290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be548e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045376:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783947003.497529:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db8563 expref: 18 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497537:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db8563 expref: 18 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947003.497548:0:17290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be549c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045504:0@lo:104: 00000100:00100000:3.0:1783947003.497622:0:17290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947003.497671:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db842f expref: 18 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497680:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db842f expref: 18 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947003.497688:0:17290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be54b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045632:0@lo:104: 00000100:00100000:2.0:1783947003.497700:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523045504 00000100:00100000:3.0:1783947003.497710:0:17290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947003.497712:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523045504 00010000:00010000:3.0:1783947003.497737:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x229d2ec450db83e2 expref: 18 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.497744:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x229d2ec450db83e2 expref: 18 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947003.497753:0:17290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be54a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045760:0@lo:104: 00000100:00100000:2.0:1783947003.497774:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523045632 00000100:00100000:3.0:1783947003.497776:0:17290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947003.497777:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523045632 00000100:00100000:3.0:1783947003.497795:0:17290:0:(client.c:2702:ptlrpc_set_wait()) set ffff91378560b840 going to sleep for 11 seconds 00000100:00100000:2.0:1783947003.497800:0:14975:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783947003.497811:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523045760 00000100:00100000:2.0:1783947003.497813:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523045760 00000100:00100000:2.0:1783947003.497830:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947003.497840:0:14974:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1783947003.497842:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+5:17290:x1870603523045504:12345-0@lo:104: 00000100:00100000:3.0:1783947003.497847:0:14974:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1783947003.497859:0:14975:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.497925:0:14975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947003.497931:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+5:17290:x1870603523045504:12345-0@lo:104: Request processed in 90us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947003.497938:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947003.497957:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947003.497963:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+4:17290:x1870603523045632:12345-0@lo:104: 00010000:00010000:2.0:1783947003.497971:0:14975:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947003.497990:0:17290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be549c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045504:0@lo:104: 00000100:00100000:3.0:1783947003.497999:0:17290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be54b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045632:0@lo:104: 00010000:00010000:2.0:1783947003.498002:0:14975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783947003.498006:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+4:17290:x1870603523045632:12345-0@lo:104: Request processed in 44us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947003.498012:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783947003.498019:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947003.498027:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.498037:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9200 already unused, calling callback (ffffffffc1499c20) 00000100:00100000:2.0:1783947003.498038:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 10000000:00010000:3.0:1783947003.498042:0:14979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.498051:0:14979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947003.498052:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff913784365c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:17290:x1870603523045760:12345-0@lo:104: 10000000:00010000:3.0:1783947003.498086:0:14979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947003.498092:0:14979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947003.503220:0:14975:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.503398:0:14975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783947003.503411:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff913784365c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39c72ff9-53ed-483b-b87f-ab321f5fef71+3:17290:x1870603523045760:12345-0@lo:104: Request processed in 5354us (5628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947003.503424:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947003.503785:0:17290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be54a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045760:0@lo:104: 00010000:00010000:2.0:1783947003.504100:0:14980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947003.508375:0:14979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.508400:0:14979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947003.508460:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.508469:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137bdca9200/0x229d2ec450db8563 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db856a expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.508495:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947003.508524:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.508532:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8c00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:3.0:1783947003.508537:0:14979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.508549:0:14979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947003.508556:0:14979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947003.508563:0:14979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947003.508652:0:14979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.508659:0:14979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947003.508677:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.508683:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137be3a8c00/0x229d2ec450db83e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db83e9 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.508693:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947003.508695:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947003.508697:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947003.508732:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947003.508763:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523046016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947003.508857:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947003.508997:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947003.509009:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39c72ff9-53ed-483b-b87f-ab321f5fef71:3449:1870603523045888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947003.509057:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947003.509154:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523046016 00000100:00100000:2.0:1783947003.509163:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523046016 00010000:00010000:2.0:1783947003.509213:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db83e2 expref: 19 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947003.509248:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523045888 00000100:00100000:2.0:1783947003.509251:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523045888 00010000:00010000:2.0:1783947003.509264:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db8563 expref: 20 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947003.509279:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947003.509287:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+20:3448:x1870603523046016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947003.509303:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947003.509309:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db83e2 expref: 20 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.509320:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db83e2 expref: 20 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.509363:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137b9f45400/0x229d2ec450db83e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db83e2 expref: 20 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.509383:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947003.509423:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3448:x1870603523046016:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947003.509431:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947003.509451:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947003.509457:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:3449:x1870603523045888:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947003.509509:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523046016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947003.509779:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947003.509785:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db8563 expref: 18 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.509794:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db8563 expref: 18 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.509806:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137be3a8000/0x229d2ec450db856a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db8563 expref: 18 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.509815:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947003.509855:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:3449:x1870603523045888:12345-0@lo:103:ldlm_bl.0 Request processed in 398us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947003.509861:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947003.510793:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39c72ff9-53ed-483b-b87f-ab321f5fef71:3449:1870603523045888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947003.512021:0:17293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947003.512037:0:17293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947003.512041:0:17293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947003.512229:0:14980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.512248:0:14980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137be3a8a00 already unused, calling callback (ffffffffc1499c20) 10000000:00010000:2.0:1783947003.512254:0:14980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.512266:0:14980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947003.512275:0:14980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947003.512282:0:14980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947003.512363:0:14980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.512370:0:14980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947003.512421:0:14980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.512429:0:14980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff9137be3a8a00/0x229d2ec450db842f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x229d2ec450db8436 expref: -99 pid: 15770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.512451:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947003.512454:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947003.512456:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947003.512556:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523046144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947003.512669:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947003.512802:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523046144 00000100:00100000:2.0:1783947003.512812:0:14978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523046144 00010000:00010000:2.0:1783947003.512850:0:14978:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db842f expref: 17 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947003.512904:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947003.512915:0:14978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:3448:x1870603523046144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947003.512931:0:14978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947003.512936:0:14978:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x229d2ec450db842f expref: 17 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.512948:0:14978:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x229d2ec450db842f expref: 17 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.512966:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913780030400/0x229d2ec450db8436 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x229d2ec450db842f expref: 17 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.512982:0:14978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947003.513034:0:14978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:3448:x1870603523046144:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947003.513042:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947003.513270:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523046144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947003.518986:0:17290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be549880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045248:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783947003.519006:0:17290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be548e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1870603523045376:192.168.201.18@tcp:104: 00010000:00010000:1.0:1783947003.519098:0:17290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947003.525455:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947003.525588:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947003.525758:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507322368 00000100:00100000:2.0:1783947003.525771:0:14978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507322368 00010000:00010000:2.0:1783947003.525833:0:14978:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ff expref: 13 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947003.525889:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507322496 00000100:00100000:2.0:1783947003.525892:0:14978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507322496 00010000:00010000:2.0:1783947003.525907:0:14978:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57229d expref: 14 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947003.525925:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1783947003.525935:0:14978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b23526e0-a156-411e-b000-ed9bfa177bc8+14:2361:x1870603507322368:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947003.525956:0:14978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947003.525963:0:14978:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ff expref: 14 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.525977:0:14978:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ff expref: 14 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526002:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9137a35bf200/0x229d2ec450db86c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5722ff expref: 14 pid: 14984 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526021:0:14978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947003.526147:0:14978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b23526e0-a156-411e-b000-ed9bfa177bc8+13:2361:x1870603507322368:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 212us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947003.526156:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1783947003.526177:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1783947003.526184:0:14978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b23526e0-a156-411e-b000-ed9bfa177bc8+12:2362:x1870603507322496:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947003.526211:0:14978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947003.526216:0:14978:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57229d expref: 12 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526226:0:14978:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57229d expref: 12 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526236:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797623a00/0x229d2ec450db8690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57229d expref: 12 pid: 14986 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526249:0:14978:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526260:0:14978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526279:0:14978:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526287:0:14978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526295:0:14978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526302:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526308:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622800 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783947003.526314:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526334:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526359:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947003.526371:0:14978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947003.526395:0:14978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b23526e0-a156-411e-b000-ed9bfa177bc8+11:2362:x1870603507322496:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 211us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947003.526402:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00010000:00010000:3.0:1783947003.528269:0:17290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.528293:0:17290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947003.528301:0:17290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff913797622800/0x229d2ec450db86f2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947003.536324:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947003.793260:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947003.793293:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523046272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947003.793406:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947003.793452:0:15779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523046272 00000100:00100000:3.0:1783947003.793464:0:15779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523046272 00000100:00100000:3.0:1783947003.793523:0:15779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947003.793539:0:15779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523046272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947003.793595:0:15779:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:3.0:1783947003.793659:0:15779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523046272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947003.795777:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523046272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947003.799768:0:15779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1783947004.561260:0:17293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783947005.008144:0:14988:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947005.008153:0:14988:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137a7c0f800 from 10 10000000:01000000:3.0:1783947005.008158:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947005.008220:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db86f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.008232:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db86f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.008243:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db86f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947005.008272:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947005.008364:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947005.008423:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91378560b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947005.008564:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523046400 00000100:00100000:0.0:1783947005.008586:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523046400 00000100:00100000:0.0:1783947005.008659:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783947005.008686:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+16:14988:x1870603523046400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947005.008704:0:14986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947005.008718:0:14986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bea00/0x229d2ec450db8700 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db86f9 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.008746:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bea00/0x229d2ec450db8700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db86f9 expref: 17 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.008757:0:14986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bea00/0x229d2ec450db8700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db86f9 expref: 17 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.008767:0:14986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bea00, rc 0) 00000100:00100000:0.0:1783947005.008833:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:14988:x1870603523046400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947005.008839:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783947005.009090:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947005.009105:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db86f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8700 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.009115:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db86f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db8700 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947005.009184:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947005.009212:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947005.009224:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91378560b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947005.009526:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523046528 00000100:00100000:0.0:1783947005.009532:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523046528 00000100:00100000:0.0:1783947005.009596:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783947005.009604:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:14988:x1870603523046528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.009731:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:14988:x1870603523046528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947005.009738:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783947005.009767:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.009792:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.009834:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947005.009856:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc9f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947005.009865:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523046656 00000100:00100000:0.0:1783947005.009873:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523046656 00000100:00100000:0.0:1783947005.009887:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783947005.009892:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:14988:x1870603523046656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.009958:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:14988:x1870603523046656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947005.009965:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783947005.009999:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947005.010838:0:17331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783947005.010913:0:14988:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783947005.010936:0:14988:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947005.010946:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db86f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8700 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.010957:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797622800/0x229d2ec450db86f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db8700 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947005.010967:0:14988:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783947005.010969:0:14988:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9137b6557000 from 10 10000000:01000000:0.0:1783947005.010973:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947005.011002:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bec00/0x229d2ec450db8707 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.011009:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff9137a35bec00/0x229d2ec450db8707 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.011020:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff9137a35bec00/0x229d2ec450db8707 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947005.011036:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.011109:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947005.011131:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947005.011146:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523046784 00000100:00100000:0.0:1783947005.011150:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523046784 00000100:00100000:0.0:1783947005.011174:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783947005.011183:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+17:14988:x1870603523046784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947005.011194:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947005.011205:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35bfc00/0x229d2ec450db870e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8707 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.011225:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35bfc00/0x229d2ec450db870e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8707 expref: 18 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.011235:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35bfc00/0x229d2ec450db870e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8707 expref: 18 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.011242:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bfc00, rc 0) 00000100:00100000:0.0:1783947005.011271:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:14988:x1870603523046784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947005.011276:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783947005.011306:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947005.011316:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff9137a35bec00/0x229d2ec450db8707 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db870e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.011325:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff9137a35bec00/0x229d2ec450db8707 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db870e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947005.011366:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.011393:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947005.011405:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947005.011413:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523046912 00000100:00100000:0.0:1783947005.011416:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523046912 00000100:00100000:0.0:1783947005.011430:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783947005.011434:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:14988:x1870603523046912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.011512:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:14988:x1870603523046912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947005.011518:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783947005.011538:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523046912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.011592:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523047040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.011622:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947005.011634:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91379d67f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947005.011643:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523047040 00000100:00100000:0.0:1783947005.011645:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523047040 00000100:00100000:0.0:1783947005.011658:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783947005.011663:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:14988:x1870603523047040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.011718:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:14988:x1870603523047040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947005.011723:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783947005.011753:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523047040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783947005.012950:0:17332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783947005.013012:0:14988:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783947005.013047:0:14988:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947005.013075:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff9137a35bec00/0x229d2ec450db8707 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db870e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.013086:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff9137a35bec00/0x229d2ec450db8707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db870e expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947005.013096:0:14988:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947005.013099:0:14988:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff913791b89000 from 10 10000000:01000000:3.0:1783947005.013101:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947005.013129:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623c00/0x229d2ec450db8715 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.013136:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff913797623c00/0x229d2ec450db8715 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.013144:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff913797623c00/0x229d2ec450db8715 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947005.013163:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be54b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523047168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947005.013222:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947005.013270:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91378560bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947005.013375:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523047168 00000100:00100000:3.0:1783947005.013380:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523047168 00000100:00100000:3.0:1783947005.013414:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783947005.013423:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+18:14988:x1870603523047168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947005.013435:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947005.013447:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797622400/0x229d2ec450db871c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x229d2ec450db8715 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.013476:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622400/0x229d2ec450db871c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x229d2ec450db8715 expref: 19 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.013485:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797622400/0x229d2ec450db871c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x229d2ec450db8715 expref: 19 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.013493:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622400, rc 0) 00000100:00100000:3.0:1783947005.013524:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:14988:x1870603523047168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.013529:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783947005.013579:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be54b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523047168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947005.013591:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff913797623c00/0x229d2ec450db8715 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db871c expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.013599:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff913797623c00/0x229d2ec450db8715 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x229d2ec450db871c expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947005.013645:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be54b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523047296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947005.013670:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947005.013683:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91378560bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947005.013693:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523047296 00000100:00100000:3.0:1783947005.013696:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523047296 00000100:00100000:3.0:1783947005.013715:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783947005.013721:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:14988:x1870603523047296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947005.013834:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:14988:x1870603523047296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.013853:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783947005.013881:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be54b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523047296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947005.013906:0:14988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be54b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523047424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947005.013944:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947005.013956:0:14988:0:(client.c:2702:ptlrpc_set_wait()) set ffff91378560bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947005.013967:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523047424 00000100:00100000:3.0:1783947005.013970:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523047424 00000100:00100000:3.0:1783947005.013992:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783947005.013998:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:14988:x1870603523047424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947005.014094:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:14988:x1870603523047424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.014101:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783947005.014138:0:14988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be54b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39c72ff9-53ed-483b-b87f-ab321f5fef71:14988:1870603523047424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947005.033797:0:17333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1783947005.034093:0:14988:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1783947005.034121:0:14988:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947005.034134:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff913797623c00/0x229d2ec450db8715 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db871c expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947005.034147:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff913797623c00/0x229d2ec450db8715 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x229d2ec450db871c expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947005.296492:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947005.296552:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947005.296588:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947005.296617:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947005.296638:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947005.296657:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947005.296679:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947005.296706:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507323008 00000100:00100000:3.0:1783947005.296715:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507323008 00000100:00100000:3.0:1783947005.296763:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507323264 00000100:00100000:3.0:1783947005.296766:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507323264 00000100:00100000:3.0:1783947005.296780:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507322880 00000100:00100000:3.0:1783947005.296795:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507322880 00000100:00100000:3.0:1783947005.296811:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507323392 00000100:00100000:3.0:1783947005.296813:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507323392 00000100:00100000:3.0:1783947005.296830:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1783947005.296840:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507323008:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947005.296920:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507323008:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 80us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.296929:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1783947005.296948:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1783947005.296954:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507323264:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947005.296980:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507323264:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.296988:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1783947005.297000:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:3.0:1783947005.297006:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507322880:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947005.297027:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507322880:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 22us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.297033:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:3.0:1783947005.297044:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1783947005.297049:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507323392:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947005.297096:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507323392:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 46us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.297103:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1783947005.297125:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507322624 00000100:00100000:3.0:1783947005.297135:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507322624 00000100:00100000:3.0:1783947005.297160:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:3.0:1783947005.297166:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+11:2362:x1870603507322624:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947005.297191:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+11:2362:x1870603507322624:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.297197:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:3.0:1783947005.297228:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507322752 00000100:00100000:3.0:1783947005.297232:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507322752 00000100:00100000:3.0:1783947005.297257:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507323136 00000100:00100000:3.0:1783947005.297260:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507323136 00000100:00100000:3.0:1783947005.297279:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:3.0:1783947005.297286:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2362:x1870603507322752:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947005.297309:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2362:x1870603507322752:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.297315:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:3.0:1783947005.297326:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:3.0:1783947005.297330:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2362:x1870603507323136:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947005.297348:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2362:x1870603507323136:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 17us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.297354:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00080000:3.0:1783947005.297372:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947005.297377:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947005.297379:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947005.553015:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947005.553385:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507323520 00000100:00100000:0.0:1783947005.553398:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507323520 00000100:00100000:0.0:1783947005.553502:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:0.0:1783947005.553528:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+11:13709:x1870603507323520:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947005.553555:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947005.553581:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9137a35be800/0x229d2ec450db8723 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f572330 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.553616:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9137a35be800/0x229d2ec450db8723 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572330 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.553628:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9137a35be800/0x229d2ec450db8723 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572330 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947005.553638:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35be800, rc 0) 00000100:00100000:0.0:1783947005.553698:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13709:x1870603507323520:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 172us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947005.553706:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:3.0:1783947005.557366:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947005.557451:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507323648 00000100:00100000:0.0:1783947005.557462:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507323648 00000100:00100000:0.0:1783947005.557519:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:0.0:1783947005.557530:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13709:x1870603507323648:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.557711:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13709:x1870603507323648:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 183us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947005.557720:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:2.0:1783947005.560795:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947005.562187:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507323776 00000100:00100000:0.0:1783947005.562201:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507323776 00000100:00100000:0.0:1783947005.562272:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:0.0:1783947005.562283:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13709:x1870603507323776:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947005.562454:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13709:x1870603507323776:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 172us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947005.562462:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:2.0:1783947005.571993:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947005.572342:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507323904 00000100:00100000:3.0:1783947005.572432:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507323904 00000100:00100000:3.0:1783947005.572545:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:3.0:1783947005.572689:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+12:13709:x1870603507323904:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947005.572718:0:14984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947005.572750:0:14984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff913797622000/0x229d2ec450db872a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x330415b06f572337 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.572798:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff913797622000/0x229d2ec450db872a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572337 expref: 13 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.572813:0:14984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff913797622000/0x229d2ec450db872a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572337 expref: 13 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947005.572823:0:14984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622000, rc 0) 00000100:00100000:3.0:1783947005.574050:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13709:x1870603507323904:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 1353us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.574836:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:1.0:1783947005.578807:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947005.578902:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507324032 00000100:00100000:0.0:1783947005.578916:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507324032 00000100:00100000:0.0:1783947005.578989:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:0.0:1783947005.579004:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13709:x1870603507324032:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947005.583995:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13709:x1870603507324032:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 4976us (5185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947005.584015:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 120 00010000:00010000:2.0:1783947005.586700:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947005.591398:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947005.591475:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507324160 00000100:00100000:3.0:1783947005.591486:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507324160 00000100:00100000:3.0:1783947005.591556:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:3.0:1783947005.591578:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13709:x1870603507324160:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947005.591762:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b23526e0-a156-411e-b000-ed9bfa177bc8+13:13709:x1870603507324160:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 186us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947005.591770:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00010000:00010000:3.0:1783947006.608295:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947007.376811:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523047552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947007.376907:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947007.377276:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523047808:0@lo:400:kworker.0 00000100:00100000:2.0:1783947007.377308:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947007.377328:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783947007.377334:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523047680:0@lo:400:kworker.0 00000100:00100000:2.0:1783947007.377382:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947007.377404:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523048192:0@lo:400:kworker.0 00000100:00100000:2.0:1783947007.377430:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947007.377524:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523047680 00000100:00100000:1.0:1783947007.377541:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523047680 00000100:00100000:1.0:1783947007.377598:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783947007.377607:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3448:x1870603523047680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947007.377663:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3448:x1870603523047680:12345-0@lo:400:kworker.0 Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947007.377681:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783947007.377731:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39c72ff9-53ed-483b-b87f-ab321f5fef71:3448:1870603523047680:0@lo:400:kworker.0 00000100:00100000:1.0:1783947007.377756:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523048064:0@lo:400:kworker.0 00000100:00100000:1.0:1783947007.377777:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947007.377795:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947007.377800:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523047936:0@lo:400:kworker.0 00000100:00100000:1.0:1783947007.377821:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947007.378055:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523047808 00000100:00100000:3.0:1783947007.378085:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523047808 00000100:00100000:3.0:1783947007.378128:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947007.378136:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523047808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947007.378184:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523047808:12345-0@lo:400:kworker.0 Request processed in 49us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947007.378191:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947007.378210:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523048192 00000100:00100000:3.0:1783947007.378213:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523048192 00000100:00100000:3.0:1783947007.378236:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523048064 00000100:00100000:3.0:1783947007.378239:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523048064 00000100:00100000:3.0:1783947007.378251:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523047936 00000100:00100000:3.0:1783947007.378253:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523047936 00000100:00100000:3.0:1783947007.378264:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947007.378271:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603523048192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947007.378301:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603523048192:12345-0@lo:400:kworker.0 Request processed in 31us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947007.378307:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947007.378317:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783947007.378322:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603523048064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947007.378349:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1870603523048064:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947007.378354:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783947007.378364:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947007.378369:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523047936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947007.378393:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1870603523047936:12345-0@lo:400:kworker.0 Request processed in 24us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947007.378399:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947007.378437:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523048192:0@lo:400:kworker.0 00000100:00100000:3.0:1783947007.378449:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523047808:0@lo:400:kworker.0 00000100:00080000:2.0:1783947007.378672:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947007.378678:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947007.378736:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523047552 00000100:00100000:0.0:1783947007.378741:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523047552 00000100:00100000:0.0:1783947007.378788:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947007.378796:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523047552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947007.378819:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1783947007.378869:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523047552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947007.378875:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1783947007.378939:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947007.382781:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3450:1870603523047936:0@lo:400:kworker.0 00000100:00100000:1.0:1783947007.382800:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3450:1870603523048064:0@lo:400:kworker.0 00000100:00100000:1.0:1783947007.382821:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523047552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783947007.632265:0:17293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947008.545372:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.545672:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507324288 00000100:00100000:3.0:1783947008.545685:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507324288 00000100:00100000:3.0:1783947008.545776:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1783947008.545788:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:14368:x1870603507324288:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947008.545814:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947008.545841:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8731 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57233e expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.545943:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.545962:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.545978:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.545996:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546004:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546011:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546293:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623200/0x229d2ec450db8746 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546372:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797623200/0x229d2ec450db8746 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546401:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623200/0x229d2ec450db8746 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947008.546446:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947008.546450:0:14992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00080000:2.0:1783947008.546617:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1783947008.546665:0:14992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913797623200/0x229d2ec450db8746 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546678:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546685:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546692:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546698:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783947008.546704:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546712:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546728:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:3.0:1783947008.546731:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947008.546736:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546743:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db8738 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546772:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546778:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546785:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546791:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783947008.546794:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546799:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546808:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9137bdc10e00) 00010000:00010000:3.0:1783947008.546810:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947008.546813:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.546818:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db873f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.547493:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8731 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57233e expref: 8 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.547532:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623200/0x229d2ec450db8746 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57233e expref: 7 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.547560:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:3.0:1783947008.547563:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947008.547566:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623200, rc 0) 00000100:00100000:3.0:1783947008.547674:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+7:14368:x1870603507324288:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1886us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947008.547684:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:2.0:1783947008.564676:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947008.564900:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507324544 00000100:00100000:0.0:1783947008.564915:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507324544 00000100:00100000:0.0:1783947008.565005:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1783947008.565018:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+7:14368:x1870603507324544:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947008.565048:0:16834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947008.565124:0:16834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db874d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572345 expref: -99 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565238:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565278:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565305:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565325:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565333:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565340:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565498:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db8762 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565507:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db8762 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565523:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db8762 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947008.565537:0:16834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783947008.565759:0:16834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565768:0:16834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565775:0:16834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565788:0:16834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947008.565793:0:16834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565801:0:16834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565816:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9137bdc10a00) 00010000:00010000:0.0:1783947008.565820:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947008.565825:0:16834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565832:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8754 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565849:0:16834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565855:0:16834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565863:0:16834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565868:0:16834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfe00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947008.565871:0:16834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565877:0:16834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565896:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9137be307a00) 00010000:00010000:0.0:1783947008.565899:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947008.565902:0:16834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.565908:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db875b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.568682:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db874d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572345 expref: 10 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.568719:0:16834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be000/0x229d2ec450db8762 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572345 expref: 9 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.568730:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137be307200) 00010000:00010000:0.0:1783947008.568734:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947008.568737:0:16834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35be000, rc 0) 00000100:00100000:0.0:1783947008.568896:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:14368:x1870603507324544:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 3878us (4233us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783947008.568907:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1783947008.584836:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.586866:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507324672 00000100:00100000:3.0:1783947008.586890:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507324672 00000100:00100000:3.0:1783947008.586989:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1783947008.587002:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:14368:x1870603507324672:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783947008.587392:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:14368:x1870603507324672:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 Request processed in 390us (2570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947008.587403:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1783947008.642825:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947008.643165:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507324800 00000100:00100000:0.0:1783947008.643179:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507324800 00000100:00100000:0.0:1783947008.643267:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1783947008.643280:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:14374:x1870603507324800:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783947008.643499:0:14993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947008.643543:0:14993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db8770 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57234c expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643649:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643666:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643681:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643699:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643706:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643714:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643776:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643784:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643791:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643797:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfe00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947008.643802:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643819:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643834:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:0.0:1783947008.643837:0:14993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947008.643842:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.643849:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644199:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644209:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644217:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644223:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947008.644226:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644233:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644241:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9137be307a00) 00010000:00010000:0.0:1783947008.644244:0:14993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947008.644247:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644264:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db877e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644458:0:14993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db8770 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57234c expref: 10 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644471:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:0.0:1783947008.644474:0:14993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947008.644477:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db8770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57234c expref: 10 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.644502:0:14993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf400, rc 0) 00000100:00100000:1.0:1783947008.645263:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:14374:x1870603507324800:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1977us (2450us total) trans 0 rc 301/301 00000100:00100000:1.0:1783947008.645277:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1783947008.651402:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947008.651619:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507324928 00000100:00100000:0.0:1783947008.651633:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507324928 00000100:00100000:0.0:1783947008.651757:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1783947008.651771:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:14374:x1870603507324928:12345-192.168.201.18@tcp:700:lfs.0 00000100:00100000:0.0:1783947008.651906:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:14374:x1870603507324928:12345-192.168.201.18@tcp:700:lfs.0 Request processed in 137us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947008.651916:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1783947008.656613:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947008.656731:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507325184 00000100:00100000:0.0:1783947008.656745:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507325184 00000100:00100000:0.0:1783947008.656888:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:0.0:1783947008.656902:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:14374:x1870603507325184:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:0.0:1783947008.656990:0:14992:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947008.657030:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db86b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5722c7 expref: 9 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.657597:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:0.0:1783947008.657604:0:14992:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947008.657689:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.657707:0:14992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572329 expref: 5 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.657717:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.657761:0:14992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572329 expref: 5 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.657780:0:14992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572329 expref: 5 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947008.657798:0:14992:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14992:1870603523048320:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783947008.658107:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947008.658352:0:14992:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792776780 going to sleep for 11 seconds 00000100:00100000:2.0:1783947008.662807:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.662900:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507325312 00000100:00100000:3.0:1783947008.662913:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507325312 00010000:00010000:3.0:1783947008.662985:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572329 expref: 6 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783947008.663334:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947008.663439:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1783947008.663454:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2361:x1870603507325312:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947008.663474:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947008.663495:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572329 expref: 6 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.663519:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572329 expref: 6 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.663569:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:3.0:1783947008.663576:0:14976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.663587:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.663596:0:14976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.663621:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947008.663702:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2361:x1870603507325312:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 252us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947008.663711:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00010000:00010000:0.0:1783947008.664993:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db86eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572329 expref: 5 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947008.665019:0:14992:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14992:1870603523048320:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783947008.665046:0:14992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.665057:0:14992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.665092:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.665432:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.665450:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.665461:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947008.667600:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783947008.667626:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.667639:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.667648:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.667654:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfe00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947008.667659:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.667667:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.667686:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10b00) 00010000:00010000:0.0:1783947008.667689:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947008.667702:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.667710:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db8785 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947008.667736:0:14992:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006275bcf reply state 000000001375e5cc transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947008.667747:0:14992:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947008.668011:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+10:14374:x1870603507325184:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 11106us (11409us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783947008.668021:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00010000:00010000:3.0:1783947008.680833:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.680868:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.680878:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.680886:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783947008.680892:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.680901:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.680947:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9137be307a00) 00010000:00010000:3.0:1783947008.680951:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947008.680956:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.680963:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db878c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947008.766849:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.766975:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507325440 00000100:00100000:3.0:1783947008.766990:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507325440 00000100:00100000:3.0:1783947008.767133:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1783947008.767147:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:14382:x1870603507325440:12345-192.168.201.18@tcp:101:lctl.0 00010000:00010000:3.0:1783947008.767184:0:16834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947008.767217:0:16834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8793 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572353 expref: -99 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.767321:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db879a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.767338:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db879a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.767352:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db879a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947008.767411:0:16834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947008.767416:0:16834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947008.767504:0:16834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db879a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.767549:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8793 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572353 expref: 11 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.767572:0:16834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623600/0x229d2ec450db879a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572353 expref: 10 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.767582:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10e00) 00010000:00010000:3.0:1783947008.767586:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947008.767591:0:16834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623600, rc 0) 00000100:00100000:3.0:1783947008.767680:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+10:14382:x1870603507325440:12345-192.168.201.18@tcp:101:lctl.0 Request processed in 535us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947008.767688:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:2.0:1783947008.800255:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.800441:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507325568 00000100:00100000:3.0:1783947008.800455:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507325568 00000100:00100000:3.0:1783947008.800613:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:3.0:1783947008.800626:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+5:14383:x1870603507325568:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783947008.800656:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947008.800685:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db87a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57235a expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.800782:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db87a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.800801:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db87a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.800816:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db87a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947008.801226:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947008.801233:0:14991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947008.801262:0:14991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db87a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.801456:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db87a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57235a expref: 7 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.801494:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622200/0x229d2ec450db87a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57235a expref: 6 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.801575:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10e00) 00010000:00010000:3.0:1783947008.801580:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947008.801584:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622200, rc 0) 00000100:00100000:3.0:1783947008.801678:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+6:14383:x1870603507325568:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1054us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947008.801688:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1783947008.805599:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.805758:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507325696 00000100:00100000:3.0:1783947008.805772:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507325696 00000100:00100000:3.0:1783947008.805853:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:3.0:1783947008.806020:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+6:14383:x1870603507325696:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783947008.806048:0:16834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947008.806227:0:16834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db87af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572361 expref: -99 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806429:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806469:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806566:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806589:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806598:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806606:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806707:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db87c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806715:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db87c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806722:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db87c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947008.806777:0:16834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947008.806781:0:16834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947008.806803:0:16834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db87c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806818:0:16834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806835:0:16834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.806855:0:16834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807287:0:16834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783947008.807456:0:16834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807467:0:16834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807496:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10e00) 00010000:00010000:3.0:1783947008.807500:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947008.807618:0:16834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807626:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807646:0:16834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807652:0:16834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807659:0:16834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807664:0:16834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783947008.807679:0:16834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807684:0:16834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807692:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9137bdc10400) 00010000:00010000:3.0:1783947008.807695:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947008.807698:0:16834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807703:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807748:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db87af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572361 expref: 8 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807763:0:16834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db87c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572361 expref: 7 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.807770:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9137bdc10300) 00010000:00010000:3.0:1783947008.807772:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947008.807774:0:16834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623000, rc 0) 00000100:00100000:3.0:1783947008.808569:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+7:14383:x1870603507325696:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2546us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947008.808581:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:2.0:1783947008.815420:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947008.815663:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507325952 00000100:00100000:0.0:1783947008.815678:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507325952 00000100:00100000:0.0:1783947008.815763:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:0.0:1783947008.815775:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+7:14383:x1870603507325952:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1783947008.815806:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947008.815839:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db87cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572368 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947008.815989:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783947008.816174:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db87cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572368 expref: 9 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.816192:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10e00) 00010000:00010000:0.0:1783947008.816195:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947008.816202:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db87cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572368 expref: 9 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.816241:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bfe00, rc 0) 00000100:00100000:0.0:1783947008.816612:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+8:14383:x1870603507325952:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 836us (1752us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1783947008.816622:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1783947008.821217:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947008.821525:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507326208 00000100:00100000:1.0:1783947008.821539:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507326208 00000100:00100000:1.0:1783947008.821621:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1783947008.821635:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+8:14383:x1870603507326208:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:1.0:1783947008.821715:0:14993:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947008.821756:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db87c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572361 expref: 8 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947008.821786:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9137bdc10300) 00010000:00010000:1.0:1783947008.821821:0:14993:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947008.822190:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947008.822207:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947008.822219:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947008.822814:0:14993:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9e956b3 reply state 0000000039246502 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947008.822829:0:14993:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783947008.822841:0:14993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783947008.823447:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+9:14383:x1870603507326208:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 1807us (2238us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1783947008.823459:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00010000:00010000:0.0:1783947008.827743:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.827766:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.827775:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.827782:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b3000 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947008.827787:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.827796:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.827819:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91378536fd00) 00010000:00010000:0.0:1783947008.827823:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1783947008.827829:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.827836:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3000/0x229d2ec450db87d9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947008.835739:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.837108:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507326464 00000100:00100000:3.0:1783947008.837139:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507326464 00000100:00100000:3.0:1783947008.837220:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1783947008.837232:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+8:14383:x1870603507326464:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1783947008.838833:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+9:14383:x1870603507326464:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 1588us (3097us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783947008.838848:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:2.0:1783947008.843430:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.843622:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507326720 00000100:00100000:3.0:1783947008.843639:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507326720 00000100:00100000:3.0:1783947008.843762:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:3.0:1783947008.843776:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+9:14383:x1870603507326720:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783947008.843809:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947008.843838:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db87e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57236f expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844083:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844101:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844128:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844147:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844154:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844161:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947008.844304:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783947008.844433:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844442:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844450:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844457:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783947008.844462:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844471:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844500:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10e00) 00010000:00010000:3.0:1783947008.844642:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947008.844650:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844659:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db87e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844677:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844683:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844689:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844706:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622c00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783947008.844709:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844716:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844726:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9137bdc10400) 00010000:00010000:3.0:1783947008.844729:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947008.844731:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844737:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db87ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844787:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db87e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57236f expref: 11 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844799:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10e00) 00010000:00010000:3.0:1783947008.844802:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947008.844806:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db87e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57236f expref: 11 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.844816:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622600, rc 0) 00000100:00100000:3.0:1783947008.845313:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+10:14383:x1870603507326720:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1537us (1894us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1783947008.845324:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:2.0:1783947008.848779:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.849003:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507326848 00000100:00100000:3.0:1783947008.849035:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507326848 00000100:00100000:3.0:1783947008.849202:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:3.0:1783947008.849217:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+10:14383:x1870603507326848:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783947008.849253:0:16834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947008.849281:0:16834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db87fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572376 expref: -99 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.849618:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.849633:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.849644:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947008.849670:0:16834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947008.849673:0:16834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947008.849692:0:16834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.849716:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db87fc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572376 expref: 12 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.849731:0:16834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572376 expref: 11 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.849738:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:3.0:1783947008.849741:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947008.849744:0:16834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623000, rc 0) 00000100:00100000:3.0:1783947008.850017:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c8e7909-7a17-4460-a5a7-eed91d187745+11:14383:x1870603507326848:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 802us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947008.850026:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:2.0:1783947008.854032:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947008.854451:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507326976 00000100:00100000:0.0:1783947008.854570:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507326976 00000100:00100000:0.0:1783947008.854687:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:0.0:1783947008.854705:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+11:14383:x1870603507326976:12345-192.168.201.18@tcp:37:lfs.0 00000100:00100000:0.0:1783947008.861097:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+11:14383:x1870603507326976:12345-192.168.201.18@tcp:37:lfs.0 Request processed in 6340us (7026us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947008.861235:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:2.0:1783947008.866432:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.866562:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507327232 00000100:00100000:3.0:1783947008.866578:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507327232 00000100:00100000:3.0:1783947008.866664:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1783947008.866677:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+11:14383:x1870603507327232:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1783947008.867180:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+12:14383:x1870603507327232:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 502us (763us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783947008.867188:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:2.0:1783947008.909545:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947008.909792:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507327360 00000100:00100000:0.0:1783947008.909806:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507327360 00000100:00100000:0.0:1783947008.909896:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1783947008.909909:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+10:14389:x1870603507327360:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1783947008.909940:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947008.909969:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db880a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57237d expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.910055:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.910301:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.910318:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910682:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910712:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910724:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910831:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db881f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910840:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db881f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910847:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db881f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947008.910911:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783947008.910915:0:14992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783947008.910960:0:14992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db881f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910976:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910983:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910991:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.910998:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783947008.911002:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911017:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911033:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10e00) 00010000:00010000:2.0:1783947008.911036:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947008.911040:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911048:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db8811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911090:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911096:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911103:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911108:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783947008.911121:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911127:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911133:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9137894a1000) 00010000:00010000:2.0:1783947008.911136:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947008.911139:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911154:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8818 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911206:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db880a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57237d expref: 12 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911221:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8600/0x229d2ec450db881f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57237d expref: 11 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.911229:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:2.0:1783947008.911232:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783947008.911234:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8600, rc 0) 00000100:00100000:2.0:1783947008.911332:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+11:14389:x1870603507327360:12345-192.168.201.18@tcp:101:bash.0 Request processed in 1425us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947008.911341:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:3.0:1783947008.912611:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523048448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947008.912697:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947008.912791:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523048448 00000100:00100000:3.0:1783947008.912801:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523048448 00000100:00100000:3.0:1783947008.912876:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947008.912887:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523048448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947008.912927:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:3.0:1783947008.912975:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523048448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947008.912984:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947008.913041:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523048448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947008.919570:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947008.919749:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507327616 00000100:00100000:1.0:1783947008.919763:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507327616 00000100:00100000:1.0:1783947008.919959:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:1.0:1783947008.919973:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+11:14389:x1870603507327616:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1783947008.920003:0:14993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947008.920033:0:14993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3600/0x229d2ec450db8826 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572384 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947008.920411:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947008.920435:0:14993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572376 expref: 11 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947008.920464:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947008.920606:0:14993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572376 expref: 11 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947008.920620:0:14993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572376 expref: 11 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947008.920635:0:14993:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14993:1870603523048576:192.168.201.18@tcp:104: 00000100:00100000:1.0:1783947008.920788:0:14993:0:(client.c:2702:ptlrpc_set_wait()) set ffff913782c88480 going to sleep for 11 seconds 00000100:00100000:2.0:1783947008.925730:0:14993:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be93ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14993:1870603523048576:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783947008.925774:0:14993:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947008.926036:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947008.926214:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507327744 00000100:00100000:0.0:1783947008.926223:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507327744 00010000:00010000:0.0:1783947008.926278:0:14977:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572376 expref: 12 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947008.926326:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:0.0:1783947008.926354:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+12:2361:x1870603507327744:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947008.926374:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947008.926383:0:14977:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572376 expref: 12 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.926397:0:14977:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572376 expref: 12 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.926429:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623000/0x229d2ec450db8803 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572376 expref: 12 pid: 16834 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.926448:0:14977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:0.0:1783947008.926455:0:14977:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.926468:0:14977:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.926491:0:14977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947008.926529:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947008.926615:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c8e7909-7a17-4460-a5a7-eed91d187745+11:2361:x1870603507327744:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 263us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947008.926624:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00010000:00010000:2.0:1783947008.926713:0:14993:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.926722:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.926755:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.926776:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.926785:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.927745:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.927762:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.927771:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947008.927785:0:14993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783947008.927824:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.927833:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.927840:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.927848:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b3e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783947008.928411:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.928428:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.928463:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:2.0:1783947008.928467:0:14993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947008.928472:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.928491:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db882d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947008.928518:0:14993:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c14d79e8 reply state 000000005f80a167 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947008.928529:0:14993:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783947008.928584:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3600/0x229d2ec450db8826 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572384 expref: 14 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.928601:0:14993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572384 expref: 13 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947008.928610:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:2.0:1783947008.928612:0:14993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783947008.928614:0:14993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9c00, rc 0) 00000100:00100000:2.0:1783947008.928695:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+14:14389:x1870603507327616:12345-192.168.201.18@tcp:101:bash.0 Request processed in 8724us (9216us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783947008.928705:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00010000:00010000:3.0:1783947008.936975:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.937001:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.937032:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.937039:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:3.0:1783947008.937045:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.937054:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.938168:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9137894a1000) 00010000:00010000:3.0:1783947008.938173:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947008.938180:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.938188:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8834 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947008.944633:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.944756:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507327872 00000100:00100000:3.0:1783947008.944768:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507327872 00000100:00100000:3.0:1783947008.944872:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:3.0:1783947008.944884:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+13:14389:x1870603507327872:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1783947008.944921:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947008.944952:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8849 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f57238b expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.945053:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.945471:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.945499:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947008.945573:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783947008.945577:0:14991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783947008.945601:0:14991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.945611:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.945638:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8849 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57238b expref: 15 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.945654:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57238b expref: 14 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947008.945661:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:3.0:1783947008.945664:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947008.945667:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622600, rc 0) 00000100:00100000:3.0:1783947008.945748:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+14:14389:x1870603507327872:12345-192.168.201.18@tcp:101:bash.0 Request processed in 867us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947008.945754:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:2.0:1783947008.950725:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947008.951247:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507328128 00000100:00100000:3.0:1783947008.951261:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507328128 00000100:00100000:3.0:1783947008.951381:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1783947008.951410:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+14:14389:x1870603507328128:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:3.0:1783947008.952173:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+15:14389:x1870603507328128:12345-192.168.201.18@tcp:35:bash.0 Request processed in 760us (1454us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1783947008.952186:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:0.0:1783947009.072705:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947009.072818:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507328384 00000100:00100000:3.0:1783947009.072833:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507328384 00000100:00100000:3.0:1783947009.072922:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:3.0:1783947009.072936:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+15:14399:x1870603507328384:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1783947009.072973:0:16834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947009.073001:0:16834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8857 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572392 expref: -99 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947009.073185:0:16834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783947009.073426:0:16834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8857 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572392 expref: 17 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.073445:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9137bdc10e00) 00010000:00010000:3.0:1783947009.073449:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947009.073454:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572392 expref: 17 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.073470:0:16834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797623a00, rc 0) 00000100:00100000:3.0:1783947009.073570:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+16:14399:x1870603507328384:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 638us (881us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1783947009.073578:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:1.0:1783947009.079426:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947009.079647:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507328640 00000100:00100000:0.0:1783947009.079662:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507328640 00000100:00100000:0.0:1783947009.079746:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1783947009.079774:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+16:14399:x1870603507328640:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1783947009.080347:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+17:14399:x1870603507328640:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 571us (932us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1783947009.080357:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1783947009.124638:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947009.124776:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507328896 00000100:00100000:2.0:1783947009.124790:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507328896 00000100:00100000:2.0:1783947009.124926:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:2.0:1783947009.124959:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+17:14402:x1870603507328896:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1783947009.125001:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947009.125033:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8865 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f572399 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.125249:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db886c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.125271:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db886c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.125287:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db886c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947009.125302:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783947009.125452:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8865 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572399 expref: 20 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.125510:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db886c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572399 expref: 19 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.125522:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:2.0:1783947009.125525:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947009.125529:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9200, rc 0) 00000100:00100000:2.0:1783947009.125625:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+19:14402:x1870603507328896:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 670us (1001us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783947009.125633:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:0.0:1783947009.129106:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947009.129215:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947009.129309:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507329024 00000100:00100000:3.0:1783947009.129341:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507329024 00000100:00100000:3.0:1783947009.129433:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:3.0:1783947009.129447:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+19:14402:x1870603507329024:12345-192.168.201.18@tcp:54:lfs.0 00000100:00100000:1.0:1783947009.129610:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507329152 00000100:00100000:1.0:1783947009.129615:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507329152 00000100:00100000:1.0:1783947009.129653:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1783947009.129660:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+20:2361:x1870603507329152:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947009.129679:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947009.129713:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db886c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572399 expref: 20 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947009.129751:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:1.0:1783947009.129757:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947009.130720:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.130751:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.130766:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.130827:0:16834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.130835:0:16834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.130843:0:16834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.130851:0:16834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623a00 already unused, calling callback (ffffffffc1aaa4f0) 00000100:00100000:1.0:1783947009.131025:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+19:2361:x1870603507329152:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1358us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947009.131037:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00010000:00010000:3.0:1783947009.132460:0:16834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.132548:0:16834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.132573:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:3.0:1783947009.132577:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947009.132583:0:16834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.132613:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db887a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947009.132725:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+18:14402:x1870603507329024:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 3276us (3629us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947009.132736:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:0.0:1783947009.135348:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947009.135452:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507329408 00000100:00100000:3.0:1783947009.135466:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507329408 00000100:00100000:3.0:1783947009.135631:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1783947009.135644:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+18:14402:x1870603507329408:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1783947009.136015:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+19:14402:x1870603507329408:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 372us (684us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1783947009.136025:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000040:00080000:0.0:1783947009.234758:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947009.426003:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947009.426162:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507329664 00000100:00100000:3.0:1783947009.426175:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507329664 00000100:00100000:3.0:1783947009.426258:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:3.0:1783947009.426270:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+19:14433:x1870603507329664:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1783947009.426313:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947009.426345:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8881 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723a0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.426533:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db8888 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.426551:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db8888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.426578:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db8888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947009.426592:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783947009.426750:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db8881 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723a0 expref: 22 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.426770:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db8888 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723a0 expref: 21 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.426778:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:3.0:1783947009.426780:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947009.426783:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622c00, rc 0) 00000100:00100000:3.0:1783947009.426871:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+21:14433:x1870603507329664:12345-192.168.201.18@tcp:101:cat.0 Request processed in 603us (883us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1783947009.427420:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1783947009.438736:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947009.438874:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507329920 00000100:00100000:0.0:1783947009.438887:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507329920 00000100:00100000:0.0:1783947009.438974:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1783947009.438987:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+21:14433:x1870603507329920:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:0.0:1783947009.439762:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+22:14433:x1870603507329920:12345-192.168.201.18@tcp:35:cat.0 Request processed in 772us (1037us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1783947009.439772:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1783947009.445734:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947009.446048:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507330048 00000100:00100000:1.0:1783947009.446169:0:14978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507330048 00000100:00100000:1.0:1783947009.446260:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:1.0:1783947009.446274:0:14978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+22:2361:x1870603507330048:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947009.446296:0:14978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947009.446331:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db8888 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723a0 expref: 22 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947009.446356:0:14978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:1.0:1783947009.446362:0:14978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947009.446612:0:14978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+21:2361:x1870603507330048:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 340us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947009.446622:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:1.0:1783947009.516212:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947009.516447:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507330304 00000100:00100000:2.0:1783947009.516488:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507330304 00000100:00100000:2.0:1783947009.516584:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:2.0:1783947009.516597:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+21:14439:x1870603507330304:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:2.0:1783947009.516632:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947009.516664:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8896 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723a7 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.516823:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.516841:0:14992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f572384 expref: 22 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.516868:0:14992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f57238b expref: 22 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.516877:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.516927:0:14992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57238b expref: 22 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.516944:0:14992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57238b expref: 22 pid: 14991 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947009.516963:0:14992:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beac9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14992:1870603523048704:192.168.201.18@tcp:104: 00010000:00010000:2.0:1783947009.517160:0:14992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572384 expref: 22 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.517183:0:14992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572384 expref: 22 pid: 14993 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947009.517194:0:14992:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14992:1870603523048832:192.168.201.18@tcp:104: 00000100:00100000:2.0:1783947009.517222:0:14992:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028480 going to sleep for 11 seconds 00000100:00100000:2.0:1783947009.522610:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947009.522707:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947009.522791:0:14992:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beac9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14992:1870603523048704:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783947009.522807:0:14992:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14992:1870603523048832:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783947009.522856:0:14992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947009.523803:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507330432 00000100:00100000:1.0:1783947009.523818:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507330432 00010000:00010000:1.0:1783947009.524020:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57238b expref: 23 pid: 14991 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947009.524080:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507330560 00000100:00100000:1.0:1783947009.524084:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507330560 00000100:00100000:2.0:1783947009.524186:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:2.0:1783947009.524202:0:14978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+24:2362:x1870603507330432:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947009.524224:0:14978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947009.524233:0:14978:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57238b expref: 24 pid: 14991 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.524248:0:14978:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57238b expref: 24 pid: 14991 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.524277:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db8850 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f57238b expref: 24 pid: 14991 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.524296:0:14978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:2.0:1783947009.524302:0:14978:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.524312:0:14978:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.524339:0:14978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947009.524462:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572384 expref: 24 pid: 14993 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947009.524671:0:14978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+23:2362:x1870603507330432:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 472us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947009.524681:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:1.0:1783947009.524800:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1783947009.524808:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+22:2362:x1870603507330560:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947009.524818:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947009.524823:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572384 expref: 22 pid: 14993 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947009.524834:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572384 expref: 22 pid: 14993 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947009.525092:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9c00/0x229d2ec450db883b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f572384 expref: 22 pid: 14993 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947009.525129:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:1.0:1783947009.525134:0:14976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947009.525144:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947009.525152:0:14976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947009.525185:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947009.525219:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+21:2362:x1870603507330560:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 412us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947009.525226:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00010000:00010000:2.0:1783947009.525392:0:14992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.525402:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947009.525427:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783947009.525647:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8896 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723a7 expref: 22 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.525667:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8200/0x229d2ec450db889d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723a7 expref: 21 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.525676:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:2.0:1783947009.525679:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783947009.525681:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8200, rc 0) 00000100:00100000:2.0:1783947009.525709:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+21:14439:x1870603507330304:12345-192.168.201.18@tcp:101:dd.0 Request processed in 9116us (9512us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783947009.525715:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1783947009.529420:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947009.529640:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507330688 00000100:00100000:2.0:1783947009.529655:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507330688 00000100:00100000:2.0:1783947009.529738:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:2.0:1783947009.529752:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+21:14439:x1870603507330688:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:2.0:1783947009.529816:0:14993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947009.529867:0:14993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db88ab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723ae expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.529919:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.529939:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.529953:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.530834:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db88ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ae expref: 23 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.531439:0:14993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ae expref: 22 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947009.531454:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:2.0:1783947009.531457:0:14993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947009.531462:0:14993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9200, rc 0) 00000100:00100000:2.0:1783947009.531743:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+22:14439:x1870603507330688:12345-192.168.201.18@tcp:101:dd.0 Request processed in 1991us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947009.531755:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:3.0:1783947009.535751:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947009.535884:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507330944 00000100:00100000:0.0:1783947009.535898:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507330944 00000100:00100000:0.0:1783947009.535981:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1783947009.535993:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+22:14439:x1870603507330944:12345-192.168.201.18@tcp:36:dd.0 00010000:00010000:0.0:1783947009.536606:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.536632:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.536646:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947009.536723:0:16834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1783947009.536770:0:16834:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2bccc09 reply state 0000000083e5bcfa transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947009.536781:0:16834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947009.537415:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+25:14439:x1870603507330944:12345-192.168.201.18@tcp:36:dd.0 Request processed in 1415us (1671us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1783947009.537428:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000020:00080000:0.0:1783947009.537437:0:16834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783947009.539742:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.539764:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.539773:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.539779:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947009.539785:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.539793:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.539817:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:0.0:1783947009.539820:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947009.539825:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.539831:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88b9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947009.541775:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947009.545053:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507331072 00000100:00100000:0.0:1783947009.545098:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507331072 00000100:00100000:0.0:1783947009.545204:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:0.0:1783947009.545218:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+24:14439:x1870603507331072:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:0.0:1783947009.545254:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947009.545287:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db88c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723b5 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.545374:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db88c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723b5 expref: 25 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.545392:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db88c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723b5 expref: 25 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.545418:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:0.0:1783947009.545422:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947009.545426:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf200, rc 0) 00000100:00100000:0.0:1783947009.545684:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+25:14439:x1870603507331072:12345-192.168.201.18@tcp:101:dd.0 Request processed in 466us (3920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947009.545693:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1783947009.563026:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947009.563331:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507331328 00000100:00100000:3.0:1783947009.563345:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507331328 00000100:00100000:3.0:1783947009.563645:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1783947009.563659:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+25:14439:x1870603507331328:12345-192.168.201.18@tcp:103:dd.0 00010000:00010000:3.0:1783947009.563682:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947009.563716:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf200/0x229d2ec450db88c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723b5 expref: 25 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.563742:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:3.0:1783947009.563748:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947009.563829:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+24:14439:x1870603507331328:12345-192.168.201.18@tcp:103:dd.0 Request processed in 172us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947009.563838:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:2.0:1783947009.566942:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947009.567320:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507331456 00000100:00100000:3.0:1783947009.567336:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507331456 00000100:00100000:3.0:1783947009.567474:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:3.0:1783947009.567489:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+24:14439:x1870603507331456:12345-192.168.201.18@tcp:58:dd.0 00010000:00010000:3.0:1783947009.567671:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.567693:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947009.567707:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783947009.569355:0:14992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947009.569680:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1783947009.569831:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1783947009.570269:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+24:14439:x1870603507331456:12345-192.168.201.18@tcp:58:dd.0 Request processed in 2775us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947009.570294:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:1.0:1783947009.573487:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947009.573797:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507331584 00000100:00100000:0.0:1783947009.573812:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507331584 00000100:00100000:0.0:1783947009.573905:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:0.0:1783947009.573919:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+24:14439:x1870603507331584:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:0.0:1783947009.573952:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947009.573983:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723bc expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.574131:0:14991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.574144:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88ce lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723bc expref: 25 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.574170:0:14991:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.574185:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88ce lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723bc expref: 25 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.574203:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:0.0:1783947009.574207:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947009.574211:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88ce lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723bc expref: 25 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947009.574219:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35be600, rc 0) 00000100:00100000:0.0:1783947009.574306:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+25:14439:x1870603507331584:12345-192.168.201.18@tcp:101:dd.0 Request processed in 390us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947009.574315:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00010000:00010000:3.0:1783947009.680555:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947010.256449:0:15026:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783947010.256487:0:15026:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947010.256525:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783947010.256538:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783947010.256730:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be582680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:15026:1870603523048960:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783947010.256885:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792781240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947010.266156:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947010.266781:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507331712 00000100:00100000:2.0:1783947010.266798:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507331712 00000100:00100000:2.0:1783947010.266896:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1783947010.266932:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+26:14440:x1870603507331712:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 00000100:00080000:3.0:1783947010.267230:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947010.267408:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+26:14440:x1870603507331712:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 Request processed in 479us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947010.267419:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1783947010.274390:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947010.274657:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507331840 00000100:00100000:3.0:1783947010.274671:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507331840 00000100:00100000:3.0:1783947010.274753:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:3.0:1783947010.274765:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+26:14440:x1870603507331840:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783947010.275316:0:16834:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783947010.276191:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+26:14440:x1870603507331840:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 732us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947010.276208:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:0.0:1783947010.276975:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be582680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:15026:1870603523048960:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947010.285859:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.285978:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507331968 00000100:00100000:0.0:1783947010.285996:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507331968 00000100:00100000:0.0:1783947010.286147:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1783947010.286160:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+25:14440:x1870603507331968:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783947010.286289:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286312:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286333:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286350:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286355:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286360:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286383:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286390:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286393:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947010.286508:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783947010.286514:0:14991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947010.286532:0:14991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286546:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286554:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286561:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286568:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947010.286573:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286580:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286593:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137be307200) 00010000:00010000:0.0:1783947010.286595:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947010.286600:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286605:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db88d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286616:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286627:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286631:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286634:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfe00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947010.286636:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286639:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286644:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9137be307800) 00010000:00010000:0.0:1783947010.286646:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947010.286647:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286651:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfe00/0x229d2ec450db88dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286663:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286666:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286669:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286672:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35be200 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947010.286677:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286682:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286686:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:0.0:1783947010.286688:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947010.286689:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.286692:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be200/0x229d2ec450db88e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947010.286776:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+25:14440:x1870603507331968:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 619us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947010.286783:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:1.0:1783947010.299224:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947010.299420:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507332224 00000100:00100000:2.0:1783947010.299436:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507332224 00000100:00100000:2.0:1783947010.299546:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:2.0:1783947010.299559:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+25:14440:x1870603507332224:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947010.299590:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947010.299621:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db88ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723c3 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.299797:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.299817:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.299832:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947010.299845:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783947010.300052:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.300112:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.300120:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.300136:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783947010.300142:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.300150:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.300167:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:2.0:1783947010.300311:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783947010.300320:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.300329:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db88f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.300406:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db88ea lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723c3 expref: 27 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.300418:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9137be307200) 00010000:00010000:2.0:1783947010.300420:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947010.300424:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db88ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723c3 expref: 27 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.300436:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8800, rc 0) 00000100:00100000:2.0:1783947010.300592:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+26:14440:x1870603507332224:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1035us (1382us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1783947010.300602:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:1.0:1783947010.309695:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.309872:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507332352 00000100:00100000:0.0:1783947010.309886:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507332352 00000100:00100000:0.0:1783947010.309970:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1783947010.309982:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+26:14440:x1870603507332352:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783947010.310036:0:14991:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783947010.310617:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+26:14440:x1870603507332352:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 632us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947010.310627:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1783947010.313942:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947010.314120:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507332608 00000100:00100000:2.0:1783947010.314152:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507332608 00000100:00100000:2.0:1783947010.314241:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:2.0:1783947010.314254:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+26:14440:x1870603507332608:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947010.314282:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947010.314310:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db88ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723ca expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947010.314872:0:14992:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1783947010.314882:0:14992:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1783947010.314913:0:14992:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1783947010.315145:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8906 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.315166:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8906 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.315181:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8906 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.315254:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db88ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ca expref: 29 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.315289:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8906 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ca expref: 28 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.315299:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:2.0:1783947010.315302:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947010.315307:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca9600, rc 0) 00000100:00100000:2.0:1783947010.315425:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+28:14440:x1870603507332608:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1172us (1496us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1783947010.315446:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:3.0:1783947010.323983:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947010.325592:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507332864 00000100:00100000:2.0:1783947010.325614:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507332864 00000100:00100000:2.0:1783947010.325708:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:2.0:1783947010.325723:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+28:14440:x1870603507332864:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947010.325810:0:14993:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947010.325850:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8906 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ca expref: 28 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.325887:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:2.0:1783947010.325900:0:14993:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947010.325938:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.325958:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.325970:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.325989:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.325996:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326003:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326132:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326141:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326149:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326156:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8800 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783947010.326161:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326170:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326192:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9137bdc10600) 00010000:00010000:2.0:1783947010.326195:0:14993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947010.326199:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326205:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8800/0x229d2ec450db8914 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326216:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326223:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326229:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326242:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca8e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783947010.326245:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326251:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326260:0:14993:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x71822555 (ffff9137894a1d00) 00010000:00010000:2.0:1783947010.326263:0:14993:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947010.326266:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.326272:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8e00/0x229d2ec450db891b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71822555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947010.328396:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+27:14440:x1870603507332864:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 2645us (4397us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947010.328415:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1783947010.336789:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947010.337003:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507332992 00000100:00100000:2.0:1783947010.337018:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507332992 00000100:00100000:2.0:1783947010.337153:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:2.0:1783947010.337167:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+27:14440:x1870603507332992:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947010.337596:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947010.337630:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8922 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723d1 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.337683:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8929 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.337722:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8929 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.337737:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8929 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.337897:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9600/0x229d2ec450db8922 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d1 expref: 29 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.337931:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca8400/0x229d2ec450db8929 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d1 expref: 28 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.337941:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:2.0:1783947010.337944:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947010.337948:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137bdca8400, rc 0) 00000100:00100000:2.0:1783947010.338050:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+28:14440:x1870603507332992:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 885us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947010.338103:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:0.0:1783947010.346499:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947010.346818:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507333248 00000100:00100000:1.0:1783947010.346835:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507333248 00000100:00100000:1.0:1783947010.346923:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:1.0:1783947010.346937:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+28:14440:x1870603507333248:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783947010.347129:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.347153:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.347168:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947010.347441:0:14991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1783947010.347463:0:14991:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 614266402845ns, next at 615266388688ns, rc = 0 00000004:00010000:1.0:1783947010.347539:0:14991:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1838067 reply state 00000000137aaa2d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947010.347552:0:14991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947010.347879:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+30:14440:x1870603507333248:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 943us (1399us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1783947010.347908:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:3.0:1783947010.359904:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.360493:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507333376 00000100:00100000:0.0:1783947010.360508:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507333376 00000100:00100000:0.0:1783947010.360601:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:0.0:1783947010.360616:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+30:14440:x1870603507333376:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947010.360651:0:16834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947010.360698:0:16834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723d8 expref: -99 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.360780:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d8 expref: 31 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.360798:0:16834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d8 expref: 31 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.360822:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:0.0:1783947010.360826:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947010.360831:0:16834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf800, rc 0) 00000100:00100000:0.0:1783947010.360908:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+31:14440:x1870603507333376:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 295us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947010.360916:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:3.0:1783947010.364026:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:1.0:1783947010.364225:0:3433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.364240:0:3433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.364248:0:3433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.364255:0:3433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b2400 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:1.0:1783947010.364261:0:3433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.364270:0:3433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.364293:0:3433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:1.0:1783947010.364297:0:3433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783947010.364302:0:3433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.364310:0:3433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b2400/0x229d2ec450db8930 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947010.364784:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507333504 00000100:00100000:0.0:1783947010.364800:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507333504 00000100:00100000:0.0:1783947010.364906:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1783947010.364921:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2363:x1870603507333504:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783947010.366183:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2363:x1870603507333504:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 1246us (2156us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783947010.366199:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00080000:3.0:1783947010.366498:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947010.380208:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.380425:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507333760 00000100:00100000:0.0:1783947010.380439:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507333760 00000100:00100000:0.0:1783947010.380531:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1783947010.380544:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+30:14440:x1870603507333760:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783947010.381214:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+31:14440:x1870603507333760:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 669us (1018us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1783947010.381240:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1783947010.387498:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947010.387834:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507334016 00000100:00100000:1.0:1783947010.387847:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507334016 00000100:00100000:1.0:1783947010.387932:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:1.0:1783947010.387946:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+31:14440:x1870603507334016:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783947010.388164:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+31:14440:x1870603507334016:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 221us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947010.388798:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:1.0:1783947010.391121:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.391330:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507334144 00000100:00100000:0.0:1783947010.391344:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507334144 00000100:00100000:0.0:1783947010.391435:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:0.0:1783947010.391448:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+31:14440:x1870603507334144:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947010.391673:0:16834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947010.391711:0:16834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db893e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723df expref: -99 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.391822:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf000/0x229d2ec450db8945 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.391840:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf000/0x229d2ec450db8945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.391854:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf000/0x229d2ec450db8945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947010.391916:0:16834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783947010.391944:0:16834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf000/0x229d2ec450db8945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.391982:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf400/0x229d2ec450db893e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723df expref: 33 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.392005:0:16834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf000/0x229d2ec450db8945 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723df expref: 32 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.392015:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:0.0:1783947010.392036:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783947010.392040:0:16834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf000, rc 0) 00000100:00100000:0.0:1783947010.393652:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+32:14440:x1870603507334144:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 2192us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947010.393667:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:3.0:1783947010.398945:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.399470:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507334272 00000100:00100000:0.0:1783947010.399629:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507334272 00000100:00100000:0.0:1783947010.399710:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1783947010.399723:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2362:x1870603507334272:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947010.399751:0:16125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947010.399781:0:16125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723e6 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947010.399815:0:16125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54df02, blocks: 0x0 00010000:00010000:0.0:1783947010.399843:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=614s v=(0 0) 00010000:00010000:0.0:1783947010.399848:0:16125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947010.399862:0:16125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723e6 expref: 7 pid: 16125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.399885:0:16125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723e6 expref: 7 pid: 16125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.399901:0:16125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9137a35bf400, rc 0) 00000100:00100000:0.0:1783947010.399977:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b65a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+7:2362:x1870603507334272:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 256us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947010.399985:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:2.0:1783947010.403760:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.404113:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507334528 00000100:00100000:0.0:1783947010.404125:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507334528 00000100:00100000:0.0:1783947010.404202:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:0.0:1783947010.404214:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+32:14440:x1870603507334528:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783947010.404366:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+32:14440:x1870603507334528:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 153us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947010.407631:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:1.0:1783947010.408840:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947010.409122:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507334656 00000100:00100000:2.0:1783947010.409136:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507334656 00000100:00100000:2.0:1783947010.409207:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1783947010.409221:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+32:14440:x1870603507334656:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783947010.411731:0:14971:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1783947010.411757:0:14971:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1783947010.411805:0:14971:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1783947010.412028:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947010.412094:0:3450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523049088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783947010.412189:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947010.412274:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523049088 00000100:00100000:1.0:1783947010.412282:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523049088 00000100:00100000:1.0:1783947010.412364:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783947010.412388:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1870603523049088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783947010.412595:0:15775:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783947010.412599:0:15775:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1783947010.412602:0:15775:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783947010.412605:0:15775:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783947010 -> 1783947010 00002000:00010000:1.0:1783947010.412607:0:15775:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783947010.412658:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3450:x1870603523049088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 284us (467us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1783947010.412665:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1783947010.412721:0:3450:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9137be7bc380/2, rc 0, transno 8589934595 00000100:00100000:1.0:1783947010.412729:0:3450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3450:1870603523049088:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1783947010.416553:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947010.418853:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+15:14440:x1870603507334656:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 9618us (10006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947010.418872:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1783947010.419955:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947010.420304:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507334912 00000100:00100000:3.0:1783947010.420316:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507334912 00000100:00080000:0.0:1783947010.420560:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947010.420655:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1783947010.420668:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507334912:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1783947010.420748:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2362:x1870603507334912:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 82us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947010.420777:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1783947010.421928:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947010.421979:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947010.422003:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947010.422033:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947010.422079:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507335168 00000100:00100000:1.0:1783947010.422101:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507335168 00000100:00100000:1.0:1783947010.422171:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507335296 00000100:00100000:1.0:1783947010.422175:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507335296 00000100:00100000:1.0:1783947010.422195:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1783947010.422204:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507335168:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783947010.422274:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507335168:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 69us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947010.422282:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1783947010.422300:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1783947010.422306:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507335296:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783947010.422333:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c8e7909-7a17-4460-a5a7-eed91d187745+5:2362:x1870603507335296:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 26us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947010.422340:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1783947010.422364:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507335040 00000100:00100000:1.0:1783947010.422597:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507335040 00000100:00100000:1.0:1783947010.422641:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:1.0:1783947010.422648:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2362:x1870603507335040:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1783947010.422692:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c8e7909-7a17-4460-a5a7-eed91d187745+6:2362:x1870603507335040:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 44us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947010.422698:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:0.0:1783947010.424207:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507334784 00000100:00100000:0.0:1783947010.424224:0:14986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507334784 00000100:00100000:0.0:1783947010.424296:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:0.0:1783947010.424307:0:14986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+13:2362:x1870603507334784:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1783947010.424487:0:14986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b23526e0-a156-411e-b000-ed9bfa177bc8+13:2362:x1870603507334784:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 64us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947010.424498:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00080000:0.0:1783947010.424546:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947010.424552:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947010.424555:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947010.427852:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947010.428406:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507335424 00000100:00100000:1.0:1783947010.428421:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507335424 00000100:00100000:1.0:1783947010.428533:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:1.0:1783947010.428546:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beaca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+7:2362:x1870603507335424:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783947010.428717:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beaca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+7:2362:x1870603507335424:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 172us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947010.428746:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:1.0:1783947010.432296:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.432408:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507335680 00000100:00100000:0.0:1783947010.432421:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507335680 00000100:00100000:0.0:1783947010.432516:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:0.0:1783947010.432530:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+15:14440:x1870603507335680:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783947010.432616:0:16834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947010.432657:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf000/0x229d2ec450db8945 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723df expref: 15 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.432706:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:0.0:1783947010.432713:0:16834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947010.432765:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.432783:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.432796:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947010.432986:0:16834:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a3282d94 reply state 00000000b2a07788 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947010.432998:0:16834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947010.433252:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+16:14440:x1870603507335680:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 724us (971us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1783947010.433261:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00010000:00010000:0.0:1783947010.437808:0:3434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.437831:0:3434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.437839:0:3434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.437846:0:3434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfa00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947010.437851:0:3434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.437890:0:3434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.437914:0:3434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:0.0:1783947010.437918:0:3434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947010.437923:0:3434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.437931:0:3434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db8953 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947010.438996:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947010.439275:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507335808 00000100:00100000:2.0:1783947010.439289:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507335808 00000100:00100000:2.0:1783947010.439359:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1783947010.439371:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+7:2361:x1870603507335808:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783947010.439610:0:15775:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783947010.439614:0:15775:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783947009 00002000:00010000:2.0:1783947010.439617:0:15775:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783947009 00002000:00010000:2.0:1783947010.439620:0:15775:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783947010 -> 1783947009 00002000:00010000:2.0:1783947010.439622:0:15775:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1783947010.439712:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+8:2361:x1870603507335808:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 342us (724us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783947010.439721:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1783947010.442846:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947010.443460:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507335936 00000100:00100000:1.0:1783947010.443538:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507335936 00000100:00100000:1.0:1783947010.443682:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1783947010.443696:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+8:2361:x1870603507335936:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783947010.443768:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.443792:0:15776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947010.443797:0:15776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947010.443804:0:15776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.443822:0:15776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.443857:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.443866:0:15776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.443875:0:15776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.443904:0:15776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b3e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:1.0:1783947010.443909:0:15776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.443920:0:15776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.443941:0:15776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.443950:0:15776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e2cdf91/0x229d2ec450db895a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947010.444107:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+8:2361:x1870603507335936:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 414us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947010.444117:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1783947010.451412:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947010.451609:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507336192 00000100:00100000:3.0:1783947010.451623:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507336192 00000100:00100000:3.0:1783947010.451705:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:3.0:1783947010.451718:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+15:14440:x1870603507336192:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783947010.451849:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.451875:0:14991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ae expref: 15 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.451888:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.451937:0:14991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ae expref: 15 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.451954:0:14991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ae expref: 15 pid: 14993 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947010.451973:0:14991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be9f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14991:1870603523049216:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783947010.452139:0:14991:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137bdc67cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947010.455821:0:14991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be9f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14991:1870603523049216:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783947010.455870:0:14991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947010.456056:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.456437:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507336320 00000100:00100000:0.0:1783947010.456446:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507336320 00010000:00010000:0.0:1783947010.456522:0:14977:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ae expref: 16 pid: 14993 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947010.456575:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1783947010.456587:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+16:2362:x1870603507336320:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947010.456609:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947010.456618:0:14977:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ae expref: 16 pid: 14993 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.456633:0:14977:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ae expref: 16 pid: 14993 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.456685:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137bdca9200/0x229d2ec450db88b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ae expref: 16 pid: 14993 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.456720:0:14977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:0.0:1783947010.456727:0:14977:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723bc expref: 15 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.456738:0:14977:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.456747:0:14977:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.456755:0:14977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.456784:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947010.456852:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+15:2362:x1870603507336320:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 267us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947010.456861:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00010000:00010000:0.0:1783947010.456890:0:14991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.456898:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.458542:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.458590:0:14991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d8 expref: 15 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.458598:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.458650:0:14991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d8 expref: 15 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.458667:0:14991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d8 expref: 15 pid: 16834 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947010.458686:0:14991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137be580e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14991:1870603523049344:192.168.201.18@tcp:104: 00000100:00100000:0.0:1783947010.458791:0:14991:0:(client.c:2702:ptlrpc_set_wait()) set ffff913792781240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947010.462976:0:14991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137be580e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14991:1870603523049344:192.168.201.18@tcp:104: 00010000:00010000:0.0:1783947010.463021:0:14991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947010.463659:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1783947010.464698:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507336448 00000100:00100000:0.0:1783947010.464713:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507336448 00010000:00010000:0.0:1783947010.464776:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d8 expref: 16 pid: 16834 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947010.464899:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1783947010.464921:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+16:2361:x1870603507336448:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947010.464942:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947010.464970:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d8 expref: 16 pid: 16834 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.464984:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d8 expref: 16 pid: 16834 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.465015:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf800/0x229d2ec450db8937 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723d8 expref: 16 pid: 16834 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.465035:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:0.0:1783947010.465041:0:14976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.465052:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.465094:0:14976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.465134:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947010.465214:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+15:2361:x1870603507336448:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 295us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947010.465224:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00010000:00010000:3.0:1783947010.465300:0:14991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.465322:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947010.465511:0:14991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1783947010.465668:0:14991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1783947010.465711:0:14991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1783947010.465837:0:14991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14991:1870603523049472:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783947010.465914:0:14991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947010.465957:0:14991:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787c04180 going to sleep for 11 seconds 00000100:00100000:2.0:1783947010.466824:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523049472 00000100:00100000:2.0:1783947010.466836:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523049472 00000100:00100000:2.0:1783947010.466917:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947010.466930:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14991:x1870603523049472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783947010.467341:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14991:x1870603523049472:12345-0@lo:1000:mdt00_000.0 Request processed in 133us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947010.467351:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947010.467412:0:14991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14991:1870603523049472:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1783947010.467713:0:14991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1783947010.467820:0:14991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beac9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14991:1870603523049600:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783947010.467884:0:14991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947010.467933:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523049600 00000100:00100000:2.0:1783947010.467947:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523049600 00000100:00100000:2.0:1783947010.467978:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947010.467985:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14991:x1870603523049600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783947010.469804:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14991:x1870603523049600:12345-0@lo:1000:mdt00_000.0 Request processed in 1801us (1901us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1783947010.469825:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947010.469871:0:14991:0:(client.c:2702:ptlrpc_set_wait()) set ffff9137980280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947010.470686:0:14991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beac9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14991:1870603523049600:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783947010.470767:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.470781:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.470790:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.470798:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bf600 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783947010.470804:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.470814:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.470836:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:2.0:1783947010.470840:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947010.470845:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.470852:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bf600/0x229d2ec450db8968 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.470992:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.471000:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.471007:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.471013:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797623a00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:2.0:1783947010.471017:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.471023:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.471032:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:2.0:1783947010.471034:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947010.471043:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723bc expref: 18 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.471229:0:14991:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88ce lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723bc expref: 18 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.471244:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723bc expref: 18 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.471733:0:14991:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35be600/0x229d2ec450db88ce lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723bc expref: 18 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947010.471770:0:14991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beac9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14991:1870603523049728:192.168.201.18@tcp:105: 00000100:00100000:2.0:1783947010.472003:0:14991:0:(client.c:2702:ptlrpc_set_wait()) set ffff913798028e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947010.476110:0:14991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beac9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14991:1870603523049728:192.168.201.18@tcp:105: 00010000:00010000:0.0:1783947010.476156:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476168:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797623a00/0x229d2ec450db88c7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476235:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476255:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476270:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476295:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476303:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476309:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476315:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137a35bfa00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947010.476319:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476327:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476341:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:0.0:1783947010.476344:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947010.476349:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476355:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137a35bfa00/0x229d2ec450db896f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476374:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476380:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476386:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476391:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622e00 already unused, calling callback (ffffffffc1aaa4f0) 00010000:00010000:0.0:1783947010.476394:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476399:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476408:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:0.0:1783947010.476410:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947010.476412:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947010.476418:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622e00/0x229d2ec450db8961 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947010.476671:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+18:14440:x1870603507336192:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 24954us (25273us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1783947010.476684:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00000020:00080000:0.0:1783947010.476692:0:14991:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783947010.479861:0:15026:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783947010.479876:0:15026:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1783947010.481246:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000040:00080000:2.0:1783947010.481370:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783947010.481382:0:15026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783947010.483557:0:3441:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1783947010.484956:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507336704 00000100:00100000:1.0:1783947010.484976:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507336704 00000100:00100000:1.0:1783947010.485043:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507336832 00000100:00100000:1.0:1783947010.485047:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507336832 00000100:00100000:1.0:1783947010.485152:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1783947010.485168:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b9ce1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+19:14440:x1870603507336704:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783947010.485643:0:14994:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783947010.485695:0:14994:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1783947010.485742:0:14994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.485779:0:14994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.485794:0:14994:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.485806:0:14994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.485813:0:14994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.485820:0:14994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947010.485976:0:14994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783947010.486412:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b9ce1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+21:14440:x1870603507336704:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 1243us (5174us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1783947010.486422:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000020:00080000:1.0:1783947010.486429:0:14994:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783947010.486505:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:1.0:1783947010.486517:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+20:14439:x1870603507336832:12345-192.168.201.18@tcp:49:dd.0 00000100:00100000:1.0:1783947010.486604:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+20:14439:x1870603507336832:12345-192.168.201.18@tcp:49:dd.0 Request processed in 90us (3064us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947010.486611:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00010000:00010000:2.0:1783947010.486739:0:17293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947010.486749:0:17293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.486760:0:17293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137927b3e00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783947010.486764:0:17293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.486774:0:17293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.486790:0:17293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9137894a1e00) 00010000:00010000:2.0:1783947010.486793:0:17293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783947010.486798:0:17293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.486804:0:17293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9137927b3e00/0x229d2ec450db8976 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14994 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.486819:0:17293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947010.486821:0:17293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947010.486823:0:17293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947010.490912:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947010.491008:0:16834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507336960 00000100:00100000:3.0:1783947010.491021:0:16834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507336960 00000100:00100000:3.0:1783947010.491140:0:16834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:3.0:1783947010.491153:0:16834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+20:14439:x1870603507336960:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:3.0:1783947010.491184:0:16834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947010.491212:0:16834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db897d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x330415b06f5723ed expref: -99 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.491261:0:16834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db8984 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.491280:0:16834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db8984 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.491296:0:16834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db8984 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.491462:0:16834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff913797622600/0x229d2ec450db897d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ed expref: 22 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.491504:0:16834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff913797622c00/0x229d2ec450db8984 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723ed expref: 21 pid: 16834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.491514:0:16834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9137894a1f00) 00010000:00010000:3.0:1783947010.491519:0:16834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783947010.491523:0:16834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff913797622c00, rc 0) 00000100:00100000:3.0:1783947010.492325:0:16834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+21:14439:x1870603507336960:12345-192.168.201.18@tcp:101:dd.0 Request processed in 1170us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947010.492337:0:16834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:2.0:1783947010.656862:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947010.656913:0:3440:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1783947010.657039:0:15781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507337216 00000100:00100000:3.0:1783947010.657051:0:15781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507337216 00000100:00100000:3.0:1783947010.657171:0:15781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507337088 00000100:00100000:3.0:1783947010.657174:0:15781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507337088 00000100:00100000:3.0:1783947010.657191:0:15781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:3.0:1783947010.657199:0:15781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+9:2364:x1870603507337216:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:3.0:1783947010.657252:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.657277:0:15781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x330415b06f5723e6 expref: 9 pid: 16125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.657287:0:15781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947010.657292:0:15781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947010.657298:0:15781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.657370:0:15781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723e6 expref: 9 pid: 16125 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.657388:0:15781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723e6 expref: 9 pid: 16125 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947010.657405:0:15781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:15781:1870603523049856:192.168.201.18@tcp:104: 00000100:00100000:3.0:1783947010.657683:0:15781:0:(client.c:2702:ptlrpc_set_wait()) set ffff913787c04840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947010.662256:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1783947010.662849:0:14978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603507337344 00000100:00100000:2.0:1783947010.662862:0:14978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603507337344 00010000:00010000:2.0:1783947010.662931:0:14978:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723e6 expref: 10 pid: 16125 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947010.663048:0:14978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:2.0:1783947010.663101:0:14978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be580e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+10:2361:x1870603507337344:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947010.663123:0:14978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947010.663155:0:14978:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723e6 expref: 10 pid: 16125 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.663171:0:14978:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723e6 expref: 10 pid: 16125 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.663205:0:14978:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947010.663211:0:14978:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947010.663231:0:14978:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.663243:0:14978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.663270:0:14978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947010.663344:0:14978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be580e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+10:2361:x1870603507337344:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 285us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947010.663371:0:14978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00010000:00010000:3.0:1783947010.664210:0:15781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a5f5c41/0x229d2ec450db894c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x330415b06f5723e6 expref: 9 pid: 16125 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947010.664232:0:15781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:15781:1870603523049856:192.168.201.18@tcp:104: 00010000:00010000:3.0:1783947010.664263:0:15781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.664276:0:15781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947010.664724:0:15781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.704301:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783947010.802367:0:16588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1783947010.802384:0:16588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1783947010.802620:0:15781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1783947010.802626:0:15781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783947009 -> 1783947010 00002000:00010000:2.0:1783947010.802628:0:15781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783947009 -> 1783947010 00002000:00010000:2.0:1783947010.802630:0:15781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1783947010.802663:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.802675:0:15781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.802683:0:15781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.802690:0:15781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff913797622600 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783947010.802694:0:15781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.802703:0:15781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.802721:0:15781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.802729:0:15781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a377ecc4/0x229d2ec450db898b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947010.802905:0:15781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+6:2364:x1870603507337216:12345-192.168.201.18@tcp:4:dd.0 Request processed in 145700us (146053us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1783947010.802919:0:15781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1783947010.802952:0:15781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:2.0:1783947010.802963:0:15781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beacb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2364:x1870603507337088:12345-192.168.201.18@tcp:4:dd.0 00002000:00010000:2.0:1783947010.803003:0:15781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a54df02, atime: 0x6a54df01, ctime: 0x6a54df02, blocks: 0x1a68 00010000:00010000:2.0:1783947010.803009:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.803020:0:15781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=614s v=(0 0) 00010000:00010000:2.0:1783947010.803025:0:15781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947010.803031:0:15781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.803042:0:15781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947010.940871:0:16588:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:2.0:1783947010.941145:0:15781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1783947010.941169:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.941181:0:15781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.941188:0:15781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.941201:0:15781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9137bdca9c00 already unused, calling callback (ffffffffc0e9e230) 00010000:00010000:2.0:1783947010.941205:0:15781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.941214:0:15781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.941240:0:15781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947010.941248:0:15781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1226eeb/0x229d2ec450db8992 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947010.941383:0:15781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beacb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22213d3f-d384-413a-8c5d-c8cad4f8a7c0+5:2364:x1870603507337088:12345-192.168.201.18@tcp:4:dd.0 Request processed in 138417us (284463us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783947010.941394:0:15781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00010000:00010000:3.0:1783947011.729039:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947012.496758:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523050240:0@lo:400:kworker.0 00000100:00100000:3.0:1783947012.496878:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947012.496950:0:3448:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783947012.496957:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523050112:0@lo:400:kworker.0 00000100:00100000:3.0:1783947012.496982:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947012.497001:0:3448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523050624:0@lo:400:kworker.0 00000100:00100000:3.0:1783947012.497027:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947012.497099:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523050240 00000100:00100000:3.0:1783947012.497108:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523050240 00000100:00100000:3.0:1783947012.497174:0:16125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523050112 00000100:00100000:3.0:1783947012.497177:0:16125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523050112 00000100:00100000:3.0:1783947012.497206:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783947012.497217:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523050240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947012.497284:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523050240:12345-0@lo:400:kworker.0 Request processed in 69us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947012.497292:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783947012.497312:0:16125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947012.497318:0:16125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523050112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947012.497345:0:16125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3448:x1870603523050112:12345-0@lo:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947012.497351:0:16125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947012.497372:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523050624 00000100:00100000:3.0:1783947012.497375:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523050624 00000100:00100000:3.0:1783947012.497402:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947012.497408:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603523050624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947012.497448:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3448:x1870603523050624:12345-0@lo:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947012.497470:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1783947012.497490:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947012.497495:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947012.497497:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947012.497541:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523050112:0@lo:400:kworker.0 00000100:00100000:3.0:1783947012.497553:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3448:1870603523050624:0@lo:400:kworker.0 00000100:00100000:3.0:1783947012.497562:0:3448:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1783947012.497568:0:3448:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9137be7bc380, transno 8589934595 00000004:00080000:3.0:1783947012.497581:0:3448:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1783947012.497605:0:3448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3448:1870603523050240:0@lo:400:kworker.0 00000100:00100000:2.0:1783947012.498102:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523050368:0@lo:400:kworker.0 00000100:00100000:2.0:1783947012.498146:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947012.498180:0:3449:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783947012.498187:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39c72ff9-53ed-483b-b87f-ab321f5fef71:3449:1870603523049984:0@lo:400:kworker.0 00000100:00100000:2.0:1783947012.498217:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947012.498254:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523050496:0@lo:400:kworker.0 00000100:00100000:2.0:1783947012.498277:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947012.498364:0:14984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523049984 00000100:00100000:0.0:1783947012.498380:0:14984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523049984 00000100:00100000:0.0:1783947012.498438:0:14984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783947012.498446:0:14984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137be7aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3449:x1870603523049984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947012.498504:0:14984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137be7aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39c72ff9-53ed-483b-b87f-ab321f5fef71+19:3449:x1870603523049984:12345-0@lo:400:kworker.0 Request processed in 59us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947012.498511:0:14984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783947012.498601:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39c72ff9-53ed-483b-b87f-ab321f5fef71:3449:1870603523049984:0@lo:400:kworker.0 00000100:00100000:3.0:1783947012.498685:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523050368 00000100:00100000:3.0:1783947012.498690:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523050368 00000100:00100000:3.0:1783947012.498923:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523050496 00000100:00100000:3.0:1783947012.498929:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523050496 00000100:00080000:1.0:1783947012.498983:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947012.499106:0:3447:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947012.499117:0:3447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137beac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523050752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947012.499154:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947012.499189:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523050752 00000100:00100000:2.0:1783947012.499193:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523050752 00000100:00100000:2.0:1783947012.499225:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947012.499233:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523050752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947012.499262:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26325568 pending 0 free 3916013568 avail 3684491264 00000100:00100000:2.0:1783947012.499302:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3447:x1870603523050752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947012.499308:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947012.499344:0:3447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137beac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3447:1870603523050752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947012.506090:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947012.506127:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523050368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947012.506285:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1870603523050368:12345-0@lo:400:kworker.0 Request processed in 177us (8138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947012.506294:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947012.506331:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783947012.506340:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137beaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523050496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947012.506374:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137beaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1870603523050496:12345-0@lo:400:kworker.0 Request processed in 36us (8096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947012.506381:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947012.507548:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3449:1870603523050496:0@lo:400:kworker.0 00000100:00100000:2.0:1783947012.507571:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3449:1870603523050368:0@lo:400:kworker.0 00000001:02000400:0.0:1783947012.711671:0:17441:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1783947012.757735:0:17293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947013.777606:0:14980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947014.033301:0:3449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9137b653d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523050880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947014.033473:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947014.033581:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870603523050880 00000100:00100000:3.0:1783947014.033590:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870603523050880 00000100:00100000:3.0:1783947014.033663:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947014.033674:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9137b653c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523050880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947014.033715:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:3.0:1783947014.033772:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9137b653c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3449:x1870603523050880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947014.033780:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1783947014.033807:0:14987:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947014.033867:0:3449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9137b653d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3449:1870603523050880:0@lo:13:osp-pre-0-0.0 Debug log: 30498 lines, 30498 kept, 0 dropped, 0 bad.